DMA-Latte: Expanding the Reach of DMA Offloads to Latency-bound ML Communication

Suchita Pati, Shaizeen Aga, Mahzabeen Islam +3

Offloading communication to existing direct memory access (DMA) engines, available on most state-of-the-art commercial GPUs, has emerged as a practical and low-cost solution to eff…