471 citations · 3.4k across the 65 of their papers we have counts for
3 papers · 2 filters
Learning Wake-Sleep Recurrent Attention Models
Jimmy Ba, Roger Grosse, Ruslan Salakhutdinov +1
Despite their success, convolutional neural networks are computationally expensive because they must examine all image locations. Stochastic attention-based models have been shown…
Importance Weighted Autoencoders
Yuri Burda, Roger Grosse, Ruslan Salakhutdinov
The variational autoencoder (VAE; Kingma, Welling (2014)) is a recently proposed generative model pairing a top-down generative network with a bottom-up recognition network which a…
Optimizing Neural Networks with Kronecker-factored Approximate Curvature
James Martens, Roger Grosse
We propose an efficient method for approximating natural gradient descent in neural networks which we call Kronecker-Factored Approximate Curvature (K-FAC). K-FAC is based on an ef…