Reminding the Incremental Language Model via Data-Free Self-Distillation

Han Wang, Ruiliu Fu, Chengzhang Li +3

Incremental language learning with pseudo-data can alleviate catastrophic forgetting in neural networks. However, to obtain better performance, former methods have higher demands f…