Is forgetting less a good inductive bias for forward transfer?

Jiefeng Chen, Timothy Nguyen, Dilan Gorur +1

One of the main motivations of studying continual learning is that the problem setting allows a model to accrue knowledge from past tasks to learn new tasks more efficiently. Howev…