123 citations · 495 across the 30 of their papers we have counts for
1 paper · 1 filter
Tianyu Chen, Shaohan Huang, Yuan Xie +5
The sparse Mixture-of-Experts (MoE) model is powerful for large-scale pre-training and has achieved promising results due to its model capacity. However, with trillions of paramete…