2 citations · 2 across the 4 of their papers we have counts for
1 paper · 1 filter
Bhavesh Kumar, Roger Jin, Jeffrey Quesnelle
As language models scale to trillions of parameters, distributed training across many GPUs becomes essential, yet gradient synchronization over high-bandwidth, low-latency networks…