Rethinking Transfer in Continual Learning: A Replay-Based Realisation

Yang Meng, Zhenya Liu, Zhuokai Zhao +1

Continual learning studies how deployed language models can continually acquire new tasks without expensive retraining from scratch. Existing methods, whether rehearsal-based (repl…