MARS: Harmonizing Multimodal Convergence via Adaptive Rank Search

Minkyoung Cho, Insu Jang, Shuowei Jin +5

Fine-tuning Multimodal Large Language Models (MLLMs) with parameter-efficient methods like Low-Rank Adaptation (LoRA) is crucial for task adaptation. However, imbalanced training d…