Talking to Yourself: Defying Forgetting in Large Language Models

Yutao Sun, Mingshuai Chen, Tiancheng Zhao +5

Catastrophic forgetting remains a major challenge when fine-tuning large language models (LLMs) on narrow, task-specific data, often degrading their general knowledge and reasoning…