The Joint Effect of Task Similarity and Overparameterization on Catastrophic Forgetting -- An Analytical Model

Daniel Goldfarb, Itay Evron, Nir Weinberger +2

In continual learning, catastrophic forgetting is affected by multiple aspects of the tasks. Previous works have analyzed separately how forgetting is affected by either task simil…