Collaborative Parameter Learning: Mitigating Forgetting via Parameter-Level Gradient Analysis

Mutian Yang, Zisen Zhan, Yutong Chen +7

Catastrophic forgetting during knowledge injection impairs the ability of large language models to acquire new knowledge without overwriting previously mastered knowledge. Recent s…