167 citations · 199 across the 6 of their papers we have counts for
Showing 2019 · stat.MLShow all
2 papers · 2 filters
stat.ML2019★ 13 cited
SPARQ-SGD: Event-Triggered and Compressed Communication in Decentralized Stochastic Optimization
Navjot Singh, Deepesh Data, Jemin George +1
In this paper, we propose and analyze SPARQ-SGD, which is an event-triggered and compressed algorithm for decentralized training of large-scale machine learning models. Each node c…
stat.ML2019
Qsparse-local-SGD: Distributed SGD with Quantization, Sparsification, and Local Computations
Debraj Basu, Deepesh Data, Can Karakus +1
Communication bottleneck has been identified as a significant issue in distributed optimization of large-scale learning models. Recently, several approaches to mitigate this proble…