Can Spectral-Clipping Enable Better Learning While Forgetting Less for Low-Rank Adaptation?

Hyowon Wi, Noseong Park

In recent years, low-rank adaptation (LoRA) has emerged as a significant paradigm that freezes pre-trained weights and introduces small, learnable adapters instead of fine-tuning t…