Towards Communication-efficient and Attack-Resistant Federated Edge Learning for Industrial Internet of Things

Abstract

Federated Edge Learning (FEL) allows edge nodes to train a global deep learning model collaboratively for edge computing in the Industrial Internet of Things (IIoT), which significantly promotes the development of Industrial 4.0. However, FEL faces two critical challenges: communication overhead and data privacy. FEL suffers from expensive communication overhead when training large-scale multi-node models. Furthermore, due to the vulnerability of FEL to gradient leakage and label-flipping attacks, the training process of the global model is easily compromised by adversaries. To address these challenges, we propose a communication-efficient and privacy-enhanced asynchronous FEL framework for edge computing in IIoT. First, we introduce an asynchronous model update scheme to reduce the computation time that edge nodes wait for global model aggregation. Second, we propose an asynchronous local differential privacy mechanism, which improves communication efficiency and mitigates gradient leakage attacks by adding well-designed noise to the gradients of edge nodes. Third, we design a cloud-side malicious node detection mechanism to detect malicious nodes by testing the local model quality. Such a mechanism can avoid malicious nodes participating in training to mitigate label-flipping attacks. Extensive experimental studies on two real-world datasets demonstrate that the proposed framework can not only improve communication efficiency but also mitigate malicious attacks while its accuracy is comparable to traditional FEL frameworks.

References in corpus (29)

• Deep Learning with Differential Privacy
• Federated Learning: Challenges, Methods, and Future Directions
• Federated Learning: Strategies for Improving Communication Efficiency
• Comprehensive Privacy Analysis of Deep Learning: Passive and Active White-box Inference Attacks against Centralized and Federated Learning
• Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training
• QSGD: Communication-Efficient SGD via Gradient Quantization and Encoding
• How To Backdoor Federated Learning
• Privacy-preserving Traffic Flow Prediction: A Federated Learning Approach
• Communication-Efficient Federated Deep Learning with Asynchronous Model Update and Temporally Weighted Aggregation
• Differentially Private Federated Learning: A Client Level Perspective
• Asynchronous Federated Optimization
• Federated Learning for 6G Communications: Challenges, Methods, and Future Directions
• Analyzing Federated Learning through an Adversarial Lens
• A generic framework for privacy preserving deep learning
• A Secure Federated Learning Framework for 5G Networks
• Extremal Mechanisms for Local Differential Privacy
• Federated Variance-Reduced Stochastic Gradient Descent with Robustness to Byzantine Attacks
• Gradient Sparsification for Communication-Efficient Distributed Optimization
• ATOMO: Communication-efficient Learning via Atomic Sparsification
• Byzantine Stochastic Gradient Descent
• Abnormal Client Behavior Detection in Federated Learning
• A Framework for Evaluating Gradient Leakage Attacks in Federated Learning
• PPGAN: Privacy-preserving Generative Adversarial Network
• Stochastic Distributed Learning with Gradient Quantization and Variance Reduction
• Dominant Dataset Selection Algorithms for Electricity Consumption Time-Series Data Analysis Based on Affine Transformation
• Data Poisoning Attacks Against Federated Learning Systems
• Towards Communication-efficient and Attack-Resistant Federated Edge Learning for Industrial Internet of Things
• The Tradeoff Between Privacy and Accuracy in Anomaly Detection Using Federated XGBoost
• Shielding Collaborative Learning: Mitigating Poisoning Attacks through Client-Side Detection

Cited by in corpus (4)

• FedDPGAN: Federated Differentially Private Generative Adversarial Networks Framework for the Detection of COVID-19 Pneumonia
• Edge-Cloud Collaborative Computing on Distributed Intelligence and Model Optimization: A Survey
• Towards Communication-efficient and Attack-Resistant Federated Edge Learning for Industrial Internet of Things
• Resource-constrained Federated Edge Learning with Heterogeneous Data: Formulation and Analysis