Take Only What You Need: Rank Minimization as an Implicit Forgetting Regularizer in Continual Learning

Haodong Lu, Chongyang Zhao, Jason Xue +3

The central tension in continual learning (CL) is the trade-off between plasticity (acquiring new knowledge) and stability (retaining prior knowledge). We study how a pre-trained b…