Restricted Orthogonal Gradient Projection for Continual Learning

Zeyuan Yang, Zonghan Yang, Peng Li +1

Continual learning aims to avoid catastrophic forgetting and effectively leverage learned experiences to master new knowledge. Existing gradient projection approaches impose hard c…