39 citations · 65 across the 15 of their papers we have counts for
Showing 2018Show all
2 papers · 1 filter
cs.LG2018★ 13 cited
The Convergence of Sparsified Gradient Methods
Dan Alistarh, Torsten Hoefler, Mikael Johansson +3
Distributed training of massive machine learning models, in particular deep neural networks, via Stochastic Gradient Descent (SGD) is becoming commonplace. Several families of comm…
math.OC2018★ 39 cited
Distributed learning with compressed gradients
Sarit Khirirat, Hamid Reza Feyzmahdavian, Mikael Johansson
Asynchronous computation and gradient compression have emerged as two key techniques for achieving scalability in distributed optimization for large-scale machine learning. This pa…