ESMFL: Efficient and Secure Models for Federated Learning
arXiv:2009.01867
Abstract
Nowadays, Deep Neural Networks are widely applied to various domains. However, massive data collection required for deep neural network reveals the potential privacy issues and also consumes large mounts of communication bandwidth. To address these problems, we propose a privacy-preserving method for the federated learning distributed system, operated on Intel Software Guard Extensions, a set of instructions that increase the security of application code and data. Meanwhile, the encrypted models make the transmission overhead larger. Hence, we reduce the commutation cost by sparsification and it can achieve reasonable accuracy with different model architectures.
arXiv comment7 pages, 3 figures, accepted by NeurIPS Workshop 2020, SpicyFL
References in corpus (12)
- Communication-Efficient Learning of Deep Networks from Decentralized Data
- Federated Learning: Strategies for Improving Communication Efficiency
- Federated Optimization: Distributed Machine Learning for On-Device Intelligence
- Federated Learning for Mobile Keyboard Prediction
- Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training
- Towards Federated Learning at Scale: System Design
- Learning Differentially Private Recurrent Language Models
- TernGrad: Ternary Gradients to Reduce Communication in Distributed Deep Learning
- Federated Optimization:Distributed Optimization Beyond the Datacenter
- Differentially Private Federated Learning: A Client Level Perspective
- A Systematic DNN Weight Pruning Framework using Alternating Direction Method of Multipliers
- Distributed Mean Estimation with Limited Communication