A Simple Baseline that Questions the Use of Pretrained-Models in Continual Learning

Paul Janson, Wenxuan Zhang, Rahaf Aljundi +1

With the success of pretraining techniques in representation learning, a number of continual learning methods based on pretrained models have been proposed. Some of these methods d…