most citedFlexible Communication for Optimal Distributed Learning over Unpredictable Networks

2 citations · 2 across the 1 of their papers we have counts for

collaborators

1 paper

cs.DC2024★ 2 cited

Flexible Communication for Optimal Distributed Learning over Unpredictable Networks

Sahil Tyagi, Martin Swany

Gradient compression alleviates expensive communication in distributed deep learning by sending fewer values and its corresponding indices, typically via Allgather (AG). Training w…