25 citations · 58 across the 4 of their papers we have counts for
3 papers · 1 filter
Is forgetting less a good inductive bias for forward transfer?
Jiefeng Chen, Timothy Nguyen, Dilan Gorur +1
One of the main motivations of studying continual learning is that the problem setting allows a model to accrue knowledge from past tasks to learn new tasks more efficiently. Howev…
Architecture Matters in Continual Learning
Seyed Iman Mirzadeh, Arslan Chaudhry, Dong Yin +4
A large body of research in continual learning is devoted to overcoming the catastrophic forgetting of neural networks by designing new algorithms that are robust to the distributi…
Linear Mode Connectivity in Multitask and Continual Learning
Seyed Iman Mirzadeh, Mehrdad Farajtabar, Dilan Gorur +2
Continual (sequential) training and multitask (simultaneous) training are often attempting to solve the same overall objective: to find a solution that performs well on all conside…