1.1k citations · 1.4k across the 16 of their papers we have counts for
Showing 2018Show all
2 papers · 1 filter
cs.LG2018★ 134 cited
Stochastic Gradient Push for Distributed Deep Learning
Mahmoud Assran, Nicolas Loizou, Nicolas Ballas +1
Distributed data-parallel algorithms aim to accelerate the training of deep neural networks by parallelizing the computation of large mini-batch gradient updates across multiple no…
cs.MA2018★ 57 cited
Asynchronous Gradient-Push
Mahmoud Assran, Michael Rabbat
We consider a multi-agent framework for distributed optimization where each agent has access to a local smooth strongly convex function, and the collective goal is to achieve conse…