SpCCL: A Sparsity-Aware Collective Communication Library for GPU Platforms

Lannie Dalton Hough, Emir Gencer, Hoffmann Muki +1

Collective communication is essential to high performance computing and machine learning workloads, yet libraries such as NCCL do not exploit sparsity in message payloads. Sending…