AnyExperts: On-Demand Expert Allocation for Multimodal Language Models with Mixture of Expert

Yuting Gao, Wang Lan, Hengyuan Zhao +3

Multimodal Mixture-of-Experts (MoE) models offer a promising path toward scalable and efficient large vision-language systems. However, existing approaches rely on rigid routing st…