1.6k citations · 1.9k across the 32 of their papers we have counts for
1 paper · 2 filters
Zixiang Chen, Yihe Deng, Yue Wu +2
The Mixture-of-Experts (MoE) layer, a sparsely-activated model controlled by a router, has achieved great success in deep learning. However, the understanding of such architecture…