1 paper
Joao Araujo, Alex Chow, Mark Handley +47
Tail latency dominates the performance of synchronous pretraining jobs when running at very large scales. We describe a three-pronged approach: (1) a new RDMA-based transport proto…