activity
20202026
most citedThe Limits and Potentials of Local SGD for Distributed Heterogeneous Learning with Intermittent Communication

1 citations · 1 across the 6 of their papers we have counts for

collaborators
Showing 2024Show all

1 paper · 1 filter

cs.LG2024★ 1 cited

The Limits and Potentials of Local SGD for Distributed Heterogeneous Learning with Intermittent Communication

Kumar Kshitij Patel, Margalit Glasgow, Ali Zindari +5

Local SGD is a popular optimization method in distributed learning, often outperforming other algorithms in practice, including mini-batch SGD. Despite this success, theoretically…