2 citations · 3 across the 5 of their papers we have counts for
1 paper · 1 filter
Weihao Yang, Hao Huang, Donglei Wu +6
Mixture-of-Experts (MoE) has become a popular architecture for scaling large models. However, the rapidly growing scale outpaces model training on a single DC, driving a shift towa…