ViMoE: An Empirical Study of Designing Vision Mixture-of-Experts

Xumeng Han, Longhui Wei, Zhiyang Dou +6

Mixture-of-Experts (MoE) models embody the divide-and-conquer concept and are a promising approach for increasing model capacity, demonstrating excellent scalability across multipl…