Do Pre-trained Models Benefit Equally in Continual Learning?

Kuan-Ying Lee, Yuanyi Zhong, Yu-Xiong Wang

Existing work on continual learning (CL) is primarily devoted to developing algorithms for models trained from scratch. Despite their encouraging performance on contrived benchmark…