DATA: Decomposed Attention-based Task Adaptation for Rehearsal-Free Continual Learning

Huanxuan Liao, Shizhu He, Yupu Hao +2

Continual learning (CL) is essential for Large Language Models (LLMs) to adapt to evolving real-world demands, yet they are susceptible to catastrophic forgetting (CF). While tradi…