Boosting the Robustness Verification of DNN by Identifying the Achilles's Heel
arXiv:1811.07108
Abstract
Deep Neural Network (DNN) is a widely used deep learning technique. How to ensure the safety of DNN-based system is a critical problem for the research and application of DNN. Robustness is an important safety property of DNN. However, existing work of verifying DNN's robustness is time-consuming and hard to scale to large-scale DNNs. In this paper, we propose a boosting method for DNN robustness verification, aiming to find counter-examples earlier. Our observation is DNN's different inputs have different possibilities of existing counter-examples around them, and the input with a small difference between the largest output value and the second largest output value tends to be the achilles's heel of the DNN. We have implemented our method and applied it on Reluplex, a state-of-the-art DNN verification tool, and four DNN attacking methods. The results of the extensive experiments on two benchmarks indicate the effectiveness of our boosting method.
arXiv comment12
References in corpus (13)
- Deep Learning in Neural Networks: An Overview
- Explaining and Harnessing Adversarial Examples
- Intriguing properties of neural networks
- Feature Squeezing: Detecting Adversarial Examples in Deep Neural Networks
- DeepXplore: Automated Whitebox Testing of Deep Learning Systems
- Formal Security Analysis of Neural Networks using Symbolic Intervals
- Testing Deep Neural Networks
- TensorFuzz: Debugging Neural Networks with Coverage-Guided Fuzzing
- Towards Proving the Adversarial Robustness of Deep Neural Networks
- DeepFool: a simple and accurate method to fool deep neural networks
- Detecting Adversarial Samples for Deep Neural Networks through Mutation Testing
- Concolic Testing for Deep Neural Networks
- DeepMutation: Mutation Testing of Deep Learning Systems