PreMoE: Proactive Inference for Efficient Mixture-of-Experts

Zehua Pei, Ying Zhang, Hui-Ling Zhen +6

Mixture-of-Experts (MoE) models offer dynamic computation, but are typically deployed as static full-capacity models, missing opportunities for deployment-specific specialization.…