23 citations · 23 across the 1 of their papers we have counts for
1 paper
Zixiang Chen, Yihe Deng, Yue Wu +2
The Mixture-of-Experts (MoE) layer, a sparsely-activated model controlled by a router, has achieved great success in deep learning. However, the understanding of such architecture…