Fine Tuning without Catastrophic Forgetting via Selective Low Rank Adaptation

Reza Akbarian Bafghi, Carden Bagwell, Avinash Ravichandran +2

Adapting deep learning models to new domains often requires computationally intensive retraining and risks catastrophic forgetting. While fine-tuning enables domain-specific adapta…