2 papers
math.OC2020
On the Convergence Analysis of Asynchronous SGD for Solving Consistent Linear Systems
Atal Narayan Sahu, Aritra Dutta, Aashutosh Tiwari +1
In the realm of big data and machine learning, data-parallel, distributed stochastic algorithms have drawn significant attention in the present days.~While the synchronous versions…
cs.DC2019
On the Discrepancy between the Theoretical Analysis and Practical Implementations of Compressed Communication for Distributed Deep Learning
Aritra Dutta, El Houcine Bergou, Ahmed M. Abdelmoniem +4
Compressed communication, in the form of sparsification or quantization of stochastic gradients, is employed to reduce communication costs in distributed data-parallel training of…