Proper Network Interpretability Helps Adversarial Robustness in Classification

Abstract

Recent works have empirically shown that there exist adversarial examples that can be hidden from neural network interpretability (namely, making network interpretation maps visually similar), or interpretability is itself susceptible to adversarial attacks. In this paper, we theoretically show that with a proper measurement of interpretation, it is actually difficult to prevent prediction-evasion adversarial attacks from causing interpretation discrepancy, as confirmed by experiments on MNIST, CIFAR-10 and Restricted ImageNet. Spurred by that, we develop an interpretability-aware defensive scheme built only on promoting robust interpretation (without the need for resorting to adversarial loss minimization). We show that our defense achieves both robust classification and robust interpretation, outperforming state-of-the-art adversarial training methods against attacks of large perturbation in particular.

arXiv comment22 pages, 9 figures, Published at ICML 2020

Cited by in corpus (6)

• When and How to Fool Explainable Models (and Humans) with Adversarial Examples
• Quantifying the Preferential Direction of the Model Gradient in Adversarial Training With Projected Gradient Descent
• Fooling Partial Dependence via Data Poisoning
• A Unified Game-Theoretic Interpretation of Adversarial Robustness
• The Definitions of Interpretability and Learning of Interpretable Models
• Interpretability Aware Model Training to Improve Robustness against Out-of-Distribution Magnetic Resonance Images in Alzheimer's Disease Classification