258 citations · 406 across the 8 of their papers we have counts for
1 paper · 1 filter
An Yang, Junyang Lin, Rui Men +12
Mixture-of-Experts (MoE) models can achieve promising results with outrageous large amount of parameters but constant computation cost, and thus it has become a trend in model scal…