Adaptive Space-efficient Collectives for Dynamic and Unstructured Sparsity on GPU Platforms

Lannie Dalton Hough, Emir Gencer, Hoffmann Muki +1

High-performance collective communication primitives are necessary for a variety of high performance computing (HPC) and machine learning (ML) workloads. State-of-the-art collectiv…