557 citations · 832 across the 25 of their papers we have counts for
4 papers · 1 filter
Learning continually with representational drift
Suzanne van der Veldt, Gido M. van de Ven, Sanne Moorman +1
Deep artificial neural networks famously struggle to learn from non-stationary streams of data. Without dedicated mitigation strategies, continual learning is associated with conti…
Forgetting of task-specific knowledge in model merging-based continual learning
Timm Hess, Gido M van de Ven, Tinne Tuytelaars
This paper investigates the linear merging of models in the context of continual learning (CL). Using controlled visual cues in computer vision experiments, we demonstrate that mer…
Continual Learning Should Move Beyond Incremental Classification
Rupert Mitchell, Antonio Alliegro, Raffaello Camoriano +17
Continual learning (CL) is the sub-field of machine learning concerned with accumulating knowledge in dynamic environments. So far, CL research has mainly focused on incremental cl…
On the Computation of the Fisher Information in Continual Learning
Gido M. van de Ven
One of the most popular methods for continual learning with deep neural networks is Elastic Weight Consolidation (EWC), which involves computing the Fisher Information. The exact w…