Geometric Asymmetry in MoE Specialization: Functional Decorrelation and Representational Overlap

Feilong Liu

Mixture-of-Experts (MoE) architectures achieve scalable capacity through sparse routing, yet the geometric structure of expert specialization remains poorly understood. We introduc…