Reducing the GPU Memory Bottleneck with Lossless Compression for ML -- Extended

Aditya K Kamath, Arvind Krishnamurthy, Marco Canini +1

Machine learning (ML) training and inference often process data sets far exceeding GPU memory capacity, forcing them to rely on PCIe for on-demand tensor transfers, causing critica…