Grow, Don't Overwrite: Fine-tuning Without Forgetting

Dyah Adila, Hanna Mazzawi, Benoit Dherin +1

Adapting pre-trained models to specialized tasks often leads to catastrophic forgetting, where new knowledge overwrites foundational capabilities. Existing methods either compromis…