5 citations · 5 across the 3 of their papers we have counts for
1 paper · 1 filter
Hao Zhao, Zihan Qiu, Huijia Wu +3
The Mixture of Experts (MoE) for language models has been proven effective in augmenting the capacity of models by dynamically routing each input token to a specific subset of expe…