UBEP: Re-architecting Expert Parallelism Communication Library for Production Superpods

Yipeng Liu, Chang Liu, Si Shen +16

The deployment of Mixture-of-Experts (MoE) models on production high-bandwidth superpods, such as NVIDIA's NVL72/576 and Huawei's CloudMatrix384, introduces critical challenges bey…