FlexLink: Boosting your NVLink Bandwidth by 27% without accuracy concern

Ao Shen, Rui Zhang, Junping Zhao

As large language models (LLMs) continue to scale, multi-node deployment has become a necessity. Consequently, communication has become a critical performance bottleneck. Current i…