963 citations · 2.6k across the 19 of their papers we have counts for
4 papers · 1 filter
Memory-Efficient Backpropagation Through Time
Audrūnas Gruslys, Remi Munos, Ivo Danihelka +2
We propose a novel approach to reduce memory consumption of the backpropagation through time (BPTT) algorithm when training recurrent neural networks (RNNs). Our approach uses dyna…
Associative Long Short-Term Memory
Ivo Danihelka, Greg Wayne, Benigno Uria +2
We investigate a new method to augment recurrent neural networks with extra memory without increasing the number of network parameters. The system has an associative memory based o…
Grid Long Short-Term Memory
Nal Kalchbrenner, Ivo Danihelka, Alex Graves
This paper introduces Grid Long Short-Term Memory, a network of LSTM cells arranged in a multidimensional grid that can be applied to vectors, sequences or higher dimensional data…
Neural Turing Machines
Alex Graves, Greg Wayne, Ivo Danihelka
We extend the capabilities of neural networks by coupling them to external memory resources, which they can interact with by attentional processes. The combined system is analogous…