SplitLoRA: Balancing Stability and Plasticity in Continual Learning Through Gradient Space Splitting

Haomiao Qiu, Miao Zhang, Ziyue Qiao +3

Continual Learning requires a model to learn multiple tasks in sequence while maintaining both stability:preserving knowledge from previously learned tasks, and plasticity:effectiv…