KeepLoRA: Continual Learning with Residual Gradient Adaptation

Mao-Lin Luo, Zi-Hao Zhou, Yi-Lin Zhang +3

Continual learning for pre-trained vision-language models requires balancing three competing objectives: retaining pre-trained knowledge, preserving knowledge from a sequence of le…