6 citations · 12 across the 8 of their papers we have counts for
1 paper · 1 filter
Hao Zhao, Zihan Qiu, Huijia Wu +3
The Mixture of Experts (MoE) for language models has been proven effective in augmenting the capacity of models by dynamically routing each input token to a specific subset of expe…