Forget About It: Mitigating Forgetting Without Replay or Auxiliary Objectives

Anat Kleiman, Gintare Karolina Dziugaite, Jonathan Frankle +2

Have we made mitigating catastrophic forgetting more complicated than it needs to be? Continual adaptation often degrades performance on earlier tasks, motivating rehearsal buffers…