Neural Turing Machines

Abstract

We extend the capabilities of neural networks by coupling them to external memory resources, which they can interact with by attentional processes. The combined system is analogous to a Turing Machine or Von Neumann architecture but is differentiable end-to-end, allowing it to be efficiently trained with gradient descent. Preliminary results demonstrate that Neural Turing Machines can infer simple algorithms such as copying, sorting, and associative recall from input and output examples.

References in corpus (1)

• Sequence to Sequence Learning with Neural Networks

Cited by in corpus (5)

• Attention-Based Models for Speech Recognition
• Zero-Shot Task Generalization with Multi-Task Deep Reinforcement Learning
• RobustFill: Neural Program Learning under Noisy I/O
• Learning Program Embeddings to Propagate Feedback on Student Code
• Scaling Memory-Augmented Neural Networks with Sparse Reads and Writes