98 citations · 135 across the 6 of their papers we have counts for
4 papers · 1 filter
Sparse Attentive Backtracking: Temporal CreditAssignment Through Reminding
Nan Rosemary Ke, Anirudh Goyal, Olexa Bilaniuk +4
Learning long-term dependencies in extended temporal sequences requires credit assignment to events far back in the past. The most common method for training recurrent neural netwo…
Generalization of Equilibrium Propagation to Vector Field Dynamics
Benjamin Scellier, Anirudh Goyal, Jonathan Binas +2
The biological plausibility of the backpropagation algorithm has long been doubted by neuroscientists. Two major reasons are that neurons would need to send two different types of…
Fortified Networks: Improving the Robustness of Deep Networks by Modeling the Manifold of Hidden Representations
Alex Lamb, Jonathan Binas, Anirudh Goyal +4
Deep networks have achieved impressive results across a variety of important tasks. However a known weakness is a failure to perform well when evaluated on data which differ from t…
Low-memory convolutional neural networks through incremental depth-first processing
Jonathan Binas, Yoshua Bengio
We introduce an incremental processing scheme for convolutional neural network (CNN) inference, targeted at embedded applications with limited memory budgets. Instead of processing…