Making LoRA Identifiable: Orthogonal Alignment for Continual Learning

Pratik Rakesh Singh, Mohammadi Zaki, Akash Saha +2

There is growing interest in applying Parameter-Efficient Fine-Tuning (PEFT) to Continual Learning, as it enables faster training, mitigates catastrophic forgetting, and facilitate…