14.5k citations · 90.1k across the 347 of their papers we have counts for
4 papers · 2 filters
Generalizable Features From Unsupervised Learning
Mehdi Mirza, Aaron Courville, Yoshua Bengio
Humans learn a predictive model of the world and use this model to reason about future events and the consequences of actions. In contrast to most machine predictors, we exhibit an…
Professor Forcing: A New Algorithm for Training Recurrent Networks
Alex Lamb, Anirudh Goyal, Ying Zhang +3
The Teacher Forcing algorithm trains recurrent networks by supplying observed sequence values as inputs during training and using the network's own one-step-ahead predictions to do…
Understanding intermediate layers using linear classifier probes
Guillaume Alain, Yoshua Bengio
Neural network models have a reputation for being black boxes. We propose to monitor the features at every layer of a model and measure how suitable they are for classification. We…
Hierarchical Memory Networks
Sarath Chandar, Sungjin Ahn, Hugo Larochelle +3
Memory networks are neural networks with an explicit memory component that can be both read and written to by the network. The memory is often addressed in a soft way using a softm…