High-dimensional Asymptotics of Generalization Performance in Continual Ridge Regression

Yihan Zhao, Wenqing Su, Ying Yang

Continual learning is motivated by the need to adapt to real-world dynamics in tasks and data distribution while mitigating catastrophic forgetting. Despite significant advances in…