3 papers
cs.CV2026
ERMoE: Eigen-Reparameterized Mixture-of-Experts for Stable Routing and Interpretable Specialization
Anzhe Cheng, Shukai Duan, Shixuan Li +8
Mixture-of-Experts (MoE) architectures expand model capacity by sparsely activating experts but face two core challenges: misalignment between router logits and each expert's inter…
cs.LG2026
EMoE: Eigenbasis-Guided Routing for Mixture-of-Experts
Anzhe Cheng, Shukai Duan, Shixuan Li +5
The relentless scaling of deep learning models has led to unsustainable computational demands, positioning Mixture-of-Experts (MoE) architectures as a promising path towards greate…
cs.CV2025
Eigen Neural Network: Unlocking Generalizable Vision with Eigenbasis
Anzhe Cheng, Chenzhong Yin, Mingxi Cheng +3
The remarkable success of Deep Neural Networks(DNN) is driven by gradient-based optimization, yet this process is often undermined by its tendency to produce disordered weight stru…