AWARe: Mitigating Catastrophic Forgetting via Activation-Weighted Adaptive REtention

Juncheng Liao, Jinfan Lv, Guoming Wang +3

Multimodal Large Language Models (MLLMs) exhibit strong generalization and reasoning abilities due to large-scale multimodal pre-training. However, fine-tuning these models on down…