16 citations · 20 across the 2 of their papers we have counts for
2 papers
cs.CL2023★ 16 cited
Continual Pre-training of Language Models
Zixuan Ke, Yijia Shao, Haowei Lin +3
Language models (LMs) have been instrumental for the rapid advance of natural language processing. This paper studies continual pre-training of LMs, in particular, continual domain…
cs.LG2022★ 4 cited
A Multi-Head Model for Continual Learning via Out-of-Distribution Replay
Gyuhak Kim, Zixuan Ke, Bing Liu
This paper studies class incremental learning (CIL) of continual learning (CL). Many approaches have been proposed to deal with catastrophic forgetting (CF) in CIL. Most methods in…