Curvature-Guided Mixing for MLLM Adaptation

Jinglong Yang, Jiaxuan He, Wenjian Huang +2

Fine-tuning Multimodal Large Language Models (MLLMs) on specialized tasks often leads to catastrophic forgetting of their general capabilities. Existing model merging methods to co…