How to Score Experts for One-Shot MoE Expert Pruning: A Unified Formulation and Selection Principle

Zongfang Liu, Jinghui Zhang, Zijian Ma +2

Mixture-of-Experts (MoE) language models reduce per-token computation through sparse expert activation, yet deployment still requires storing the full expert pool, making one-shot…