8 citations · 32 across the 32 of their papers we have counts for
1 paper · 2 filters
Zeliang Zhang, Xiaodong Liu, Hao Cheng +2
By increasing model parameters but activating them sparsely when performing a task, the use of Mixture-of-Experts (MoE) architecture significantly improves the performance of Large…