Characterizing Adversarial Subspaces Using Local Intrinsic Dimensionality
arXiv:1801.02613
Abstract
Deep Neural Networks (DNNs) have recently been shown to be vulnerable against adversarial examples, which are carefully crafted instances that can mislead DNNs to make errors during prediction. To better understand such attacks, a characterization is needed of the properties of regions (the so-called 'adversarial subspaces') in which adversarial examples lie. We tackle this challenge by characterizing the dimensional properties of adversarial regions, via the use of Local Intrinsic Dimensionality (LID). LID assesses the space-filling capability of the region surrounding a reference example, based on the distance distribution of the example to its neighbors. We first provide explanations about how adversarial perturbation can affect the LID characteristic of adversarial regions, and then show empirically that LID characteristics can facilitate the distinction of adversarial examples generated using state-of-the-art attacks. As a proof-of-concept, we show that a potential application of LID is to distinguish adversarial examples, and the preliminary results show that it can outperform several state-of-the-art detection measures by large margins for five attack strategies considered in this paper across three benchmark datasets. Our analysis of the LID characteristic for adversarial regions not only motivates new directions of effective adversarial defense, but also opens up more challenges for developing new attacks to better understand the vulnerabilities of DNNs.
References in corpus (10)
- Feature Squeezing: Detecting Adversarial Examples in Deep Neural Networks
- Transferability in Machine Learning: from Phenomena to Black-Box Attacks using Adversarial Samples
- Delving into Transferable Adversarial Examples and Black-box Attacks
- Towards Deep Neural Network Architectures Robust to Adversarial Examples
- Robust Physical-World Attacks on Deep Learning Models
- The Space of Transferable Adversarial Examples
- On the (Statistical) Detection of Adversarial Examples
- A Boundary Tilting Persepective on the Phenomenon of Adversarial Examples
- Adversarial Example Defenses: Ensembles of Weak Defenses are not Strong
- Adversarial Examples Detection in Deep Networks with Convolutional Filter Statistics
Cited by in corpus (114)
- Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examples
- Theoretically Principled Trade-off between Robustness and Accuracy
- Synthesizing Robust Adversarial Examples
- Understanding Adversarial Attacks on Deep Learning Based Medical Image Analysis Systems
- Guiding Deep Learning System Testing using Surprise Adequacy
- Adversarial Examples: Opportunities and Challenges
- Dimensionality-Driven Learning with Noisy Labels
- Adversarial Weight Perturbation Helps Robust Generalization
- Adversarial Example Detection for DNN Models: A Review and Experimental Comparison
- Adversarial Machine Learning in Image Classification: A Survey Towards the Defender's Perspective
- Motivating the Rules of the Game for Adversarial Example Research
- Intrinsic dimension of data representations in deep neural networks
- advertorch v0.1: An Adversarial Robustness Toolbox based on PyTorch
- Interpreting and Improving Adversarial Robustness of Deep Neural Networks with Neuron Sensitivity
- A Review of Adversarial Attack and Defense for Classification Methods
- AttriGuard: A Practical Defense Against Attribute Inference Attacks via Adversarial Machine Learning
- DeepRobust: A PyTorch Library for Adversarial Attacks and Defenses
- Gotta Catch 'Em All: Using Honeypots to Catch Adversarial Attacks on Neural Networks
- Adversarial Attack and Defense on Point Sets
- The Limitations of Adversarial Training and the Blind-Spot Attack
- Security and Privacy Issues in Deep Learning
- Detection of Face Recognition Adversarial Attacks
- Convergence of Adversarial Training in Overparametrized Neural Networks
- A Survey of Safety and Trustworthiness of Deep Neural Networks: Verification, Testing, Adversarial Attack and Defence, and Interpretability
- RAB: Provable Robustness Against Backdoor Attacks
- Towards Robust Neural Networks via Random Self-ensemble
- NATTACK: Learning the Distributions of Adversarial Examples for an Improved Black-Box Attack on Deep Neural Networks
- Towards Stable and Efficient Training of Verifiably Robust Neural Networks
- Confidence-Calibrated Adversarial Training: Generalizing to Unseen Attacks
- Daedalus: Breaking Non-Maximum Suppression in Object Detection via Adversarial Examples
- Deep Verifier Networks: Verification of Deep Discriminative Models with Deep Generative Models
- Exploring Architectural Ingredients of Adversarially Robust Deep Neural Networks
- Toward Robust Image Classification
- On the Limitation of Local Intrinsic Dimensionality for Characterizing the Subspaces of Adversarial Examples
- Understanding the One-Pixel Attack: Propagation Maps and Locality Analysis
- Adversarial Examples in Deep Learning: Characterization and Divergence
- High Dimensional Spaces, Deep Learning and Adversarial Examples
- AdvFlow: Inconspicuous Black-box Adversarial Attacks using Normalizing Flows
- A Simple Fine-tuning Is All You Need: Towards Robust Deep Learning Via Adversarial Fine-tuning
- Evolving Robust Neural Architectures to Defend from Adversarial Attacks
- Regional Homogeneity: Towards Learning Transferable Universal Adversarial Perturbations Against Defenses
- Adversarial Camouflage: Hiding Physical-World Attacks with Natural Styles
- Interpretable Deep Learning under Fire
- Clean-Label Backdoor Attacks on Video Recognition Models
- Enhancing the Robustness of Deep Neural Networks by Boundary Conditional GAN
- Defending Against Adversarial Examples with K-Nearest Neighbor
- Breaking Transferability of Adversarial Samples with Randomness
- DaST: Data-free Substitute Training for Adversarial Attacks
- Adversarial Image Color Transformations in Explicit Color Filter Space
- Bag of Tricks for Adversarial Training
- Towards Robust Detection of Adversarial Examples
- Detecting Adversarial Examples Is (Nearly) As Hard As Classifying Them
- Enhancing Gradient-based Attacks with Symbolic Intervals
- Towards Security Threats of Deep Learning Systems: A Survey
- Distributionally Adversarial Attack
- On Certifying Non-uniform Bound against Adversarial Attacks
- Adversarial Robustness Assessment: Why both and Attacks Are Necessary
- Anomalous Example Detection in Deep Learning: A Survey
- Effective and Robust Detection of Adversarial Examples via Benford-Fourier Coefficients
- Using Undervolting as an On-Device Defense Against Adversarial Machine Learning Attacks
- Denoised Internal Models: a Brain-Inspired Autoencoder against Adversarial Attacks
- Imbalanced Gradients: A Subtle Cause of Overestimated Adversarial Robustness
- Instance Correction for Learning with Open-set Noisy Labels
- LiBRe: A Practical Bayesian Approach to Adversarial Detection
- Detecting Adversarial Examples via Neural Fingerprinting
- On the Certified Robustness for Ensemble Models and Beyond
- Enhancing Adversarial Defense by k-Winners-Take-All
- Attacking and Defending Machine Learning Applications of Public Cloud
- TSS: Transformation-Specific Smoothing for Robustness Certification
- Defending against Adversarial Attack towards Deep Neural Networks via Collaborative Multi-task Training
- Random Directional Attack for Fooling Deep Neural Networks
- Defending against adversarial attacks on medical imaging AI system, classification or detection?
- Evading Adversarial Example Detection Defenses with Orthogonal Projected Gradient Descent
- Almost Tight L0-norm Certified Robustness of Top-k Predictions against Adversarial Perturbations
- Adversarial Defense by Stratified Convolutional Sparse Coding
- The Adversarial Attack and Detection under the Fisher Information Metric
- One Bit Matters: Understanding Adversarial Examples as the Abuse of Redundancy
- Customizing an Adversarial Example Generator with Class-Conditional GANs
- RobOT: Robustness-Oriented Testing for Deep Learning Systems
- Trust but Verify: An Information-Theoretic Explanation for the Adversarial Fragility of Machine Learning Systems, and a General Defense against Adversarial Attacks
- Are Adversarial Examples Created Equal? A Learnable Weighted Minimax Risk for Robustness under Non-uniform Attacks
- Intrinsic Geometric Vulnerability of High-Dimensional Artificial Intelligence
- Medical Aegis: Robust adversarial protectors for medical images
- Toward Metrics for Differentiating Out-of-Distribution Sets
- Purifying Adversarial Perturbation with Adversarially Trained Auto-encoders
- A Unified Game-Theoretic Interpretation of Adversarial Robustness
- Uncovering the Connections Between Adversarial Transferability and Knowledge Transferability
- Detecting Patch Adversarial Attacks with Image Residuals
- Representation Quality Of Neural Networks Links To Adversarial Attacks and Defences
- Exploiting the Sensitivity of Adversarial Examples to Erase-and-Restore
- A Survey on Assessing the Generalization Envelope of Deep Neural Networks: Predictive Uncertainty, Out-of-distribution and Adversarial Samples
- Perceptual Deep Neural Networks: Adversarial Robustness through Input Recreation
- A Hierarchical Feature Constraint to Camouflage Medical Adversarial Attacks
- On The Utility of Conditional Generation Based Mutual Information for Characterizing Adversarial Subspaces
- MixDefense: A Defense-in-Depth Framework for Adversarial Example Detection Based on Statistical and Semantic Analysis
- The art of defense: letting networks fool the attacker
- Improving White-box Robustness of Pre-processing Defenses via Joint Adversarial Training
- Multi-Expert Adversarial Attack Detection in Person Re-identification Using Context Inconsistency
- Adv-4-Adv: Thwarting Changing Adversarial Perturbations via Adversarial Domain Adaptation
- Adversarial Examples Detection beyond Image Space
- Interpretable Disentanglement of Neural Networks by Extracting Class-Specific Subnetwork
- Learning To Characterize Adversarial Subspaces
- Defending SVMs against Poisoning Attacks: the Hardness and DBSCAN Approach
- Adversarial Imitation Attack
- Training Provably Robust Models by Polyhedral Envelope Regularization
- Improving Adversarial Robustness for Free with Snapshot Ensemble
- A Sweet Rabbit Hole by DARCY: Using Honeypots to Detect Universal Trigger's Adversarial Attacks
- On Configurable Defense against Adversarial Example Attacks
- Weighted Average Precision: Adversarial Example Detection in the Visual Perception of Autonomous Vehicles
- Linking average- and worst-case perturbation robustness via class selectivity and dimensionality
- Denoising and Verification Cross-Layer Ensemble Against Black-box Adversarial Attacks
- Likelihood Landscapes: A Unifying Principle Behind Many Adversarial Defenses
- BAARD: Blocking Adversarial Examples by Testing for Applicability, Reliability and Decidability
- Generative Image Inpainting with Submanifold Alignment