A New Lens on Multi-GPU Communication: API-Level Memory Models for Portable Optimization

Johnathan Alsop, Bradford Beckmann, Brandon Potter +5

As network communication increasingly becomes a performance bottleneck for ML and HPC workloads, it is more important than ever to optimize multi-GPU data transfers. Recently, low-…