SLSGD: Secure and Efficient Distributed On-device Machine Learning
arXiv:1903.06996
Abstract
We consider distributed on-device learning with limited communication and security requirements. We propose a new robust distributed optimization algorithm with efficient communication and attack tolerance. The proposed algorithm has provable convergence and robustness under non-IID settings. Empirical results show that the proposed algorithm stabilizes the convergence and tolerates data poisoning on a small number of workers.
References in corpus (13)
- MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
- Communication-Efficient Learning of Deep Networks from Decentralized Data
- Federated Learning: Strategies for Improving Communication Efficiency
- MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems
- How To Backdoor Federated Learning
- Byzantine-Robust Distributed Learning: Towards Optimal Statistical Rates
- Federated Optimization:Distributed Optimization Beyond the Datacenter
- Pointer Sentinel Mixture Models
- Mitigating Sybils in Federated Learning Poisoning
- Big Data Caching for Networking: Moving from Cloud to Edge
- Local SGD Converges Fast and Communicates Little
- Security and Privacy Issues in Deep Learning
- Phocas: dimensional Byzantine-resilient stochastic gradient descent