13 citations · 27 across the 4 of their papers we have counts for
4 papers · 1 filter
Byzantine-Resilient High-Dimensional Federated Learning
Deepesh Data, Suhas Diggavi
We study stochastic gradient descent (SGD) with local iterations in the presence of malicious/Byzantine clients, motivated by the federated learning. The clients, instead of commun…
Byzantine-Resilient SGD in High Dimensions on Heterogeneous Data
Deepesh Data, Suhas Diggavi
We study distributed stochastic gradient descent (SGD) in the master-worker architecture under Byzantine attacks. We consider the heterogeneous data model, where different workers…
SPARQ-SGD: Event-Triggered and Compressed Communication in Decentralized Stochastic Optimization
Navjot Singh, Deepesh Data, Jemin George +1
In this paper, we propose and analyze SPARQ-SGD, which is an event-triggered and compressed algorithm for decentralized training of large-scale machine learning models. Each node c…
Qsparse-local-SGD: Distributed SGD with Quantization, Sparsification, and Local Computations
Debraj Basu, Deepesh Data, Can Karakus +1
Communication bottleneck has been identified as a significant issue in distributed optimization of large-scale learning models. Recently, several approaches to mitigate this proble…