328 citations · 1.6k across the 61 of their papers we have counts for
4 papers · 1 filter
Sparse Attentive Backtracking: Temporal CreditAssignment Through Reminding
Nan Rosemary Ke, Anirudh Goyal, Olexa Bilaniuk +4
Learning long-term dependencies in extended temporal sequences requires credit assignment to events far back in the past. The most common method for training recurrent neural netwo…
Generalization of Equilibrium Propagation to Vector Field Dynamics
Benjamin Scellier, Anirudh Goyal, Jonathan Binas +2
The biological plausibility of the backpropagation algorithm has long been doubted by neuroscientists. Two major reasons are that neurons would need to send two different types of…
Fortified Networks: Improving the Robustness of Deep Networks by Modeling the Manifold of Hidden Representations
Alex Lamb, Jonathan Binas, Anirudh Goyal +4
Deep networks have achieved impressive results across a variety of important tasks. However a known weakness is a failure to perform well when evaluated on data which differ from t…
Recall Traces: Backtracking Models for Efficient Reinforcement Learning
Anirudh Goyal, Philemon Brakel, William Fedus +5
In many environments only a tiny subset of all states yield high reward. In these cases, few of the interactions with the environment provide a relevant learning signal. Hence, we…