De-Pois: An Attack-Agnostic Defense against Data Poisoning Attacks

Abstract

Machine learning techniques have been widely applied to various applications. However, they are potentially vulnerable to data poisoning attacks, where sophisticated attackers can disrupt the learning procedure by injecting a fraction of malicious samples into the training dataset. Existing defense techniques against poisoning attacks are largely attack-specific: they are designed for one specific type of attacks but do not work for other types, mainly due to the distinct principles they follow. Yet few general defense strategies have been developed. In this paper, we propose De-Pois, an attack-agnostic defense against poisoning attacks. The key idea of De-Pois is to train a mimic model the purpose of which is to imitate the behavior of the target model trained by clean samples. We take advantage of Generative Adversarial Networks (GANs) to facilitate informative training data augmentation as well as the mimic model construction. By comparing the prediction differences between the mimic model and the target model, De-Pois is thus able to distinguish the poisoned samples from clean ones, without explicit knowledge of any ML algorithms or types of poisoning attacks. We implement four types of poisoning attacks and evaluate De-Pois with five typical defense methods on different realistic datasets. The results demonstrate that De-Pois is effective and efficient for detecting poisoned data against all the four types of poisoning attacks, with both the accuracy and F1-score over 0.9 on average.

arXiv commentTo be published in IEEE Transactions on Information Forensics and Security

References in corpus (15)

• Conditional Generative Adversarial Nets
• GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
• Wild Patterns: Ten Years After the Rise of Adversarial Machine Learning
• Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoning
• BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chain
• Poisoning Attacks against Support Vector Machines
• Generative Poisoning Attack Method Against Neural Networks
• Sever: A Robust Meta-Algorithm for Stochastic Optimization
• Transferable Clean-Label Poisoning Attacks on Deep Neural Nets
• A Bayesian Data Augmentation Approach for Learning Deep Models
• Detection of Adversarial Training Examples in Poisoning Attacks through Anomaly Detection
• Stronger Data Poisoning Attacks Break Data Sanitization Defenses
• Poisoning Attacks with Generative Adversarial Nets
• Training Set Debugging Using Trusted Items
• Regularisation Can Mitigate Poisoning Attacks: A Novel Analysis Based on Multiobjective Bilevel Optimisation