Analytical Resource Management for Fine-grained MoE Computation-Communication Overlap

Hongyu Liu, Minyu Cui, Miquel Pericas

Fine-grained computation--communication overlap in distributed Mixture-of-Experts (MoE) inference allows communication to begin as partial compute results become ready. However, co…