1 paper · 1 filter
Xin Zhao, Xiaojun Chen, Bingshan Liu +3
Large language models (LLMs) with Mixture-of-Experts (MoE) architectures achieve impressive performance and efficiency by dynamically routing inputs to specialized subnetworks, kno…