Towards Continual Learning: Mitigating Forgetting With Subspace Tuning

Arnav Chavan, Kusha Sareen, Rishabh Tiwari +6

Large language models (LLMs) acquire new skills through fine-tuning, but it can destroy capabilities they already have: catastrophic forgetting remains a central obstacle to contin…