activity
20172021
most citedOvercoming catastrophic forgetting in neural networks

7.8k citations · 8.3k across the 5 of their papers we have counts for

collaborators

6 papers

astro-ph.GA2021★ 7 cited

A Deep Learning Approach for Characterizing Major Galaxy Mergers

Skanda Koppula, Victor Bapst, Marc Huertas-Company +15

Fine-grained estimation of galaxy merger stages from observations is a key problem useful for validation of our current theoretical understanding of galaxy formation. To this end,…

cs.LG2019

Gated Linear Networks

Joel Veness, Tor Lattimore, David Budden +8

This paper presents a new family of backpropagation-free neural architectures, Gated Linear Networks (GLNs). What distinguishes GLNs from contemporary neural networks is the distri…

stat.ML2018★ 281 cited

Progress & Compress: A scalable framework for continual learning

Jonathan Schwarz, Jelena Luketina, Wojciech M. Czarnecki +4

We introduce a conceptually simple and scalable framework for continual learning domains where tasks are learned sequentially. Our method is constant in the number of parameters an…

cs.LG2018★ 141 cited

Unsupervised Predictive Memory in a Goal-Directed Agent

Greg Wayne, Chia-Chun Hung, David Amos +21

Animals execute goal-directed behaviours despite the limited range and scope of their sensors. To cope, they explore environments and store memories maintaining estimates of import…

cs.LG2017★ 18 cited

Online Learning with Gated Linear Networks

Joel Veness, Tor Lattimore, Avishkar Bhoopchand +3

This paper describes a family of probabilistic architectures designed for online learning under the logarithmic loss. Rather than relying on non-linear transfer functions, our meth…

cs.LG2017★ 7.8k cited

Overcoming catastrophic forgetting in neural networks

James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz +11

The ability to learn tasks in a sequential fashion is crucial to the development of artificial intelligence. Neural networks are not, in general, capable of this and it has been wi…