5 citations · 8 across the 2 of their papers we have counts for
2 papers
cs.DC2018★ 3 cited
SuperNeurons: FFT-based Gradient Sparsification in the Distributed Training of Deep Neural Networks
Linnan Wang, Wei Wu, Junyu Zhang +4
The performance and efficiency of distributed training of Deep Neural Networks highly depend on the performance of gradient averaging among all participating nodes, which is bounde…
cs.DC2016★ 5 cited
Efficient Communications in Training Large Scale Neural Networks
Linnan Wang, Wei Wu, George Bosilca +2
We consider the problem of how to reduce the cost of communication that is required for the parallel training of a neural network. The state-of-the-art method, Bulk Synchronous Par…