KeepLoRA++: Continual Learning with Layer-Scaled Residual Gradient Adaptation

Mao-Lin Luo, Yi-Lin Zhang, Zi-Hao Zhou +5

Continual learning for pre-trained vision-language models requires balancing three competing objectives: retaining pre-trained knowledge, preserving knowledge from a sequence of le…