Continual Fine-Tuning with Provably Accurate and Parameter-Free Task Retrieval

Hang Thi-Thuy Le, Long Minh Bui, Minh Hoang +1

Continual fine-tuning aims to adapt a pre-trained backbone to new tasks sequentially while preserving performance on earlier tasks whose data are no longer available. Existing appr…