Enhancing Multi-modal Models with Heterogeneous MoE Adapters for Fine-tuning

Sashuai Zhou, Hai Huang, Yan Xia

Multi-modal models excel in cross-modal tasks but are computationally expensive due to their billions of parameters. Parameter-efficient fine-tuning (PEFT) offers a solution by add…