Memory-Statistics Tradeoff in Continual Learning with Structural Regularization

Haoran Li, Jingfeng Wu, Vladimir Braverman

We study the statistical performance of a continual learning problem with two linear regression tasks in a well-specified random design setting. We consider a structural regulariza…