AIMMerging: Adaptive Iterative Model Merging Using Training Trajectories for Language Model Continual Learning

Yujie Feng, Jian Li, Xiaoyu Dong +8

Continual learning (CL) is essential for deploying large language models (LLMs) in dynamic real-world environments without the need for costly retraining. Recent model merging-base…