ACE: Adaptive Calibration-Free Expert Skipping for MoE-based LLMs

Zukang Xu, Zhixiong Zhao, Xing Hu +5

Mixture-of-Experts (MoE) architectures provide an efficient paradigm for scaling large language models (LLMs), yet fixed top-k routing activates the same number of expert slots for…