23 citations · 30 across the 5 of their papers we have counts for
1 paper · 1 filter
Zixiang Chen, Yihe Deng, Yue Wu +2
The Mixture-of-Experts (MoE) layer, a sparsely-activated model controlled by a router, has achieved great success in deep learning. However, the understanding of such architecture…