Sparse Orthogonal Parameters Tuning for Continual Learning

Kun-Peng Ning, Hai-Jian Ke, Yu-Yang Liu +3

Continual learning methods based on pre-trained models (PTM) have recently gained attention which adapt to successive downstream tasks without catastrophic forgetting. These method…