Provable Effects of Data Replay in Continual Learning: A Feature Learning Perspective

Meng Ding, Jinhui Xu, Kaiyi Ji

Continual learning (CL) aims to train models on a sequence of tasks while retaining performance on previously learned ones. A core challenge in this setting is catastrophic forgett…