Shielding Collaborative Learning: Mitigating Poisoning Attacks through Client-Side Detection

Abstract

Collaborative learning allows multiple clients to train a joint model without sharing their data with each other. Each client performs training locally and then submits the model updates to a central server for aggregation. Since the server has no visibility into the process of generating the updates, collaborative learning is vulnerable to poisoning attacks where a malicious client can generate a poisoned update to introduce backdoor functionality to the joint model. The existing solutions for detecting poisoned updates, however, fail to defend against the recently proposed attacks, especially in the non-IID setting. In this paper, we present a novel defense scheme to detect anomalous updates in both IID and non-IID settings. Our key idea is to realize client-side cross-validation, where each update is evaluated over other clients' local data. The server will adjust the weights of the updates based on the evaluation results when performing aggregation. To adapt to the unbalanced distribution of data in the non-IID setting, a dynamic client allocation mechanism is designed to assign detection tasks to the most suitable clients. During the detection process, we also protect the client-level privacy to prevent malicious clients from stealing the training data of other clients, by integrating differential privacy with our design without degrading the detection performance. Our experimental evaluations on two real-world datasets show that our scheme is significantly robust to two representative poisoning attacks.

References in corpus (12)

• Deep Learning with Differential Privacy
• Communication-Efficient Learning of Deep Networks from Decentralized Data
• Federated Learning: Strategies for Improving Communication Efficiency
• Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training
• BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chain
• How To Backdoor Federated Learning
• Learning Differentially Private Recurrent Language Models
• Byzantine-Robust Distributed Learning: Towards Optimal Statistical Rates
• Differentially Private Federated Learning: A Client Level Perspective
• Mitigating Sybils in Federated Learning Poisoning
• Distributed Statistical Machine Learning in Adversarial Settings: Byzantine Gradient Descent
• Security Analysis of Online Centroid Anomaly Detection

Cited by in corpus (1)

• Towards Communication-efficient and Attack-Resistant Federated Edge Learning for Industrial Internet of Things