Reflecting on the State of Rehearsal-free Continual Learning with Pretrained Models

Lukas Thede, Karsten Roth, Olivier J. Hénaff +2

With the advent and recent ubiquity of foundation models, continual learning (CL) has recently shifted from continual training from scratch to the continual adaptation of pretraine…