MegaFlux: Skew-Resilient MoE Megakernels via Pipelined Expert Replication

Jianzhu Yao, Siva Kumar Sastry Hari, Vignesh Balaji +4

Mixture-of-experts (MoE) megakernels fuse expert-parallel communication with expert computation. However, under fixed expert placement, routing skew creates GPU stragglers: overloa…