Cross-Entropy Loss and Low-Rank Features Have Responsibility for Adversarial Examples

Abstract

State-of-the-art neural networks are vulnerable to adversarial examples; they can easily misclassify inputs that are imperceptibly different than their training and test data. In this work, we establish that the use of cross-entropy loss function and the low-rank features of the training data have responsibility for the existence of these inputs. Based on this observation, we suggest that addressing adversarial examples requires rethinking the use of cross-entropy loss function and looking for an alternative that is more suited for minimization with low-rank features. In this direction, we present a training scheme called differential training, which uses a loss function defined on the differences between the features of points from opposite classes. We show that differential training can ensure a large margin between the decision boundary of the neural network and the points in the training dataset. This larger margin increases the amount of perturbation needed to flip the prediction of the classifier and makes it harder to find an adversarial example with small perturbations. We test differential training on a binary classification task with CIFAR-10 dataset and demonstrate that it radically reduces the ratio of images for which an adversarial example could be found -- not only in the training dataset, but in the test dataset as well.

References in corpus (2)

• Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examples
• Adversarially Robust Generalization Requires More Data

Cited by in corpus (15)

• Supervised Contrastive Learning
• Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning
• Understanding the Failure Modes of Out-of-Distribution Generalization
• Gradient Starvation: A Learning Proclivity in Neural Networks
• Towards a Robust Deep Neural Network in Texts: A Survey
• Adversarial Attack Framework on Graph Embedding Models with Limited Knowledge
• Understanding the Decision Boundary of Deep Neural Networks: An Empirical Study
• Boundary thickness and robustness in learning models
• KNN-BERT: Fine-Tuning Pre-Trained Models with KNN Classifier
• A Restricted Black-box Adversarial Framework Towards Attacking Graph Embedding Models
• DDPNOpt: Differential Dynamic Programming Neural Optimizer
• A Differential Game Theoretic Neural Optimizer for Training Residual Networks
• UniMoCo: Unsupervised, Semi-Supervised and Full-Supervised Visual Representation Learning
• A Framework for Behavior Privacy Preserving in Radio Frequency Signal
• Adaptive versus Standard Descent Methods and Robustness Against Adversarial Examples