963 citations · 2.6k across the 19 of their papers we have counts for
Showing 2016 · cs.NEShow all
2 papers · 2 filters
cs.NE2016★ 51 cited
Memory-Efficient Backpropagation Through Time
Audrūnas Gruslys, Remi Munos, Ivo Danihelka +2
We propose a novel approach to reduce memory consumption of the backpropagation through time (BPTT) algorithm when training recurrent neural networks (RNNs). Our approach uses dyna…
cs.NE2016★ 105 cited
Associative Long Short-Term Memory
Ivo Danihelka, Greg Wayne, Benigno Uria +2
We investigate a new method to augment recurrent neural networks with extra memory without increasing the number of network parameters. The system has an associative memory based o…