Explanation-Guided Backdoor Poisoning Attacks Against Malware Classifiers

Abstract

Training pipelines for machine learning (ML) based malware classification often rely on crowdsourced threat feeds, exposing a natural attack injection point. In this paper, we study the susceptibility of feature-based ML malware classifiers to backdoor poisoning attacks, specifically focusing on challenging "clean label" attacks where attackers do not control the sample labeling process. We propose the use of techniques from explainable machine learning to guide the selection of relevant features and values to create effective backdoor triggers in a model-agnostic fashion. Using multiple reference datasets for malware classification, including Windows PE files, PDFs, and Android applications, we demonstrate effective attacks against a diverse set of machine learning models and evaluate the effect of various constraints imposed on the attacker. To demonstrate the feasibility of our backdoor attacks in practice, we create a watermarking utility for Windows PE files that preserves the binary's functionality, and we leverage similar behavior-preserving alteration methodologies for Android and PDF files. Finally, we experiment with potential defensive strategies and show the difficulties of completely defending against these attacks, especially when the attacks blend in with the legitimate sample distribution.

arXiv comment18 pages, 5 figures. To appear in USENIX Security 2021

References in corpus (13)

• Explaining and Harnessing Adversarial Examples
• Axiomatic Attribution for Deep Networks
• Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoning
• BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chain
• Poisoning Attacks against Support Vector Machines
• On Evaluating Adversarial Robustness
• Spectral Signatures in Backdoor Attacks
• Adversarial Perturbations Against Deep Neural Networks for Malware Classification
• Is feature selection secure against training data poisoning?
• Detecting Backdoor Attacks on Deep Neural Networks by Activation Clustering
• EMBER: An Open Dataset for Training Static PE Malware Machine Learning Models
• Machine Learning Aided Static Malware Analysis: A Survey and Tutorial
• Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networks

Cited by in corpus (7)

• Backdoor Attacks and Countermeasures on Deep Learning: A Comprehensive Review
• Deep Learning for Android Malware Defenses: a Systematic Literature Review
• You Autocomplete Me: Poisoning Vulnerabilities in Neural Code Completion
• Markov Chain Monte Carlo-Based Machine Unlearning: Unlearning What Needs to be Forgotten
• TrojanZoo: Towards Unified, Holistic, and Practical Evaluation of Neural Backdoors
• Good-looking but Lacking Faithfulness: Understanding Local Explanation Methods through Trend-based Testing
• Being Single Has Benefits. Instance Poisoning to Deceive Malware Classifiers