activity
20092019
most citedCan Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descent

399 citations · 471 across the 3 of their papers we have counts for

collaborators
Showing 2017 · math.OCShow all

1 paper · 2 filters

math.OC2017★ 399 cited

Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descent

Xiangru Lian, Ce Zhang, Huan Zhang +3

Most distributed machine learning systems nowadays, including TensorFlow and CNTK, are built in a centralized fashion. One bottleneck of centralized algorithms lies on high communi…