most citedPyTorch-Direct: Enabling GPU Centric Data Access for Very Large Graph Neural Network Training with Irregular Accesses

3 citations · 6 across the 3 of their papers we have counts for

collaborators
Showing cs.DCShow all

1 paper · 1 filter

cs.DC2024

SSDTrain: An Activation Offloading Framework to SSDs for Faster Large Language Model Training

Kun Wu, Jeongmin Brian Park, Xiaofan Zhang +5

The growth rate of the GPU memory capacity has not been able to keep up with that of the size of large language models (LLMs), hindering the model training process. In particular,…