Graceful Forgetting in Generative Language Models

Chunyang Jiang, Chi-min Chan, Yiyang Cai +3

Recently, the pretrain-finetune paradigm has become a cornerstone in various deep learning areas. While in general the pre-trained model would promote both effectiveness and effici…