SlimWise: Decoupling Expert Pruning Across Prefill and Decode for Efficient MoE Serving

Gunho Park, Kyoungho Jeun, Juntaek Oh +3

Mixture-of-experts (MoE) models activate few experts per token, yet batched decoding can access nearly the entire expert pool, making expert-weight traffic a major bottleneck. Expe…