SPACE-LoRA: Allocating Activation-Subspace Protection for Continual Learning

Seunghyun Yoo, Kiseok Kim, Hyeontae Joo +2

This study addresses the catastrophic forgetting problem that occurs when sequentially learning successive tasks using Low-Rank Adaptation (LoRA) from a lifelong learning perspecti…