1 paper
Gongli Zhang, Zhulin Liu, C. L. Philip Chen
Mixture-of-experts (MoE) models have recently moved beyond routing a fixed number of complete experts. Shared-expert designs preserve reusable knowledge, fine-grained methods vary…