5 citations · 9 across the 23 of their papers we have counts for
1 paper · 1 filter
Xin Zhao, Xiaojun Chen, Bingshan Liu +3
Large language models (LLMs) with Mixture-of-Experts (MoE) architectures achieve impressive performance and efficiency by dynamically routing inputs to specialized subnetworks, kno…