Brain-inspired reverse adversarial examples
arXiv:1905.12171
Abstract
A human does not have to see all elephants to recognize an animal as an elephant. On contrast, current state-of-the-art deep learning approaches heavily depend on the variety of training samples and the capacity of the network. In practice, the size of network is always limited and it is impossible to access all the data samples. Under this circumstance, deep learning models are extremely fragile to human-imperceivable adversarial examples, which impose threats to all safety critical systems. Inspired by the association and attention mechanisms of the human brain, we propose reverse adversarial examples method that can greatly improve models' robustness on unseen data. Experiments show that our reverse adversarial method can improve accuracy on average 19.02% on ResNet18, MobileNet, and VGG16 on unseen data transformation. Besides, the proposed method is also applicable to compressed models and shows potential to compensate the robustness drop brought by model quantization - an absolute 30.78% accuracy improvement.
Preprint
References in corpus (11)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
- Towards Deep Learning Models Resistant to Adversarial Attacks
- Transferability in Machine Learning: from Phenomena to Black-Box Attacks using Adversarial Samples
- Synthesizing Robust Adversarial Examples
- Incremental Network Quantization: Towards Lossless CNNs with Low-Precision Weights
- Generating Adversarial Malware Examples for Black-Box Attacks Based on GAN
- Generating Adversarial Examples with Adversarial Networks
- Structured Adversarial Attack: Towards General Implementation and Better Interpretability
- Sparse DNNs with Improved Adversarial Robustness
- Defensive Quantization: When Efficiency Meets Robustness