Analysis of Overparameterization in Continual Learning under a Linear Model

Daniel Goldfarb, Paul Hand

Autonomous machine learning systems that learn many tasks in sequence are prone to the catastrophic forgetting problem. Mathematical theory is needed in order to understand the ext…