activity
20192026
most citedGlobal Momentum Compression for Sparse Communication in Distributed Learning

1 citations · 1 across the 4 of their papers we have counts for

collaborators
Showing 2026Show all

1 paper · 1 filter

cs.LG2026

Ordered Local Momentum for Asynchronous Distributed Learning under Arbitrary Delays

Chang-Wei Shi, Shi-Shang Wang, Wu-Jun Li

Momentum SGD (MSGD) serves as a foundational optimizer in training deep models due to momentum's key role in accelerating convergence and enhancing generalization. Meanwhile, async…