ConPET: Continual Parameter-Efficient Tuning for Large Language Models

Chenyang Song, Xu Han, Zheni Zeng +5

Continual learning necessitates the continual adaptation of models to newly emerging tasks while minimizing the catastrophic forgetting of old ones. This is extremely challenging f…