14.1k citations · 34.6k across the 53 of their papers we have counts for
Showing 2016 · stat.MLShow all
2 papers · 2 filters
stat.ML2016★ 154 cited
Using Fast Weights to Attend to the Recent Past
Jimmy Ba, Geoffrey Hinton, Volodymyr Mnih +2
Until recently, research on artificial neural networks was largely restricted to systems with only two types of variable: Neural activities that represent the current or recent inp…
stat.ML2016★ 499 cited
Layer Normalization
Jimmy Lei Ba, Jamie Ryan Kiros, Geoffrey E. Hinton
Training state-of-the-art, deep neural networks is computationally expensive. One way to reduce the training time is to normalize the activities of the neurons. A recently introduc…