most citedA Distributed Synchronous SGD Algorithm with Global Top- Sparsification for Low Bandwidth Networks

9 citations · 9 across the 1 of their papers we have counts for

collaborators

1 paper

cs.DC2019★ 9 cited

A Distributed Synchronous SGD Algorithm with Global Top- Sparsification for Low Bandwidth Networks

Shaohuai Shi, Qiang Wang, Kaiyong Zhao +4

Distributed synchronous stochastic gradient descent (S-SGD) has been widely used in training large-scale deep neural networks (DNNs), but it typically requires very high communicat…