Identifying Model Weakness with Adversarial Examiner
arXiv:1911.11230
Abstract
Machine learning models are usually evaluated according to the average case performance on the test set. However, this is not always ideal, because in some sensitive domains (e.g. autonomous driving), it is the worst case performance that matters more. In this paper, we are interested in systematic exploration of the input data space to identify the weakness of the model to be evaluated. We propose to use an adversarial examiner in the testing stage. Different from the existing strategy to always give the same (distribution of) test data, the adversarial examiner will dynamically select the next test data to hand out based on the testing history so far, with the goal being to undermine the model's performance. This sequence of test data not only helps us understand the current model, but also serves as constructive feedback to help improve the model in the next iteration. We conduct experiments on ShapeNet object classification. We show that our adversarial examiner can successfully put more emphasis on the weakness of the model, preventing performance estimates from being overly optimistic.
To appear in AAAI-20
References in corpus (15)
- Adam: A Method for Stochastic Optimization
- Practical Bayesian Optimization of Machine Learning Algorithms
- ZOO: Zeroth Order Optimization based Black-box Attacks to Deep Neural Networks without Training Substitute Models
- Robust Physical-World Attacks on Deep Learning Models
- Black-box Adversarial Attacks with Limited Queries and Information
- Virtual Worlds as Proxy for Multi-Object Tracking Analysis
- Why do deep convolutional networks generalize so poorly to small image transformations?
- Simple Black-Box Adversarial Perturbations for Deep Networks
- Motivating the Rules of the Game for Adversarial Example Research
- Towards Practical Verification of Machine Learning: The Case of Computer Vision Systems
- Unrestricted Adversarial Examples
- Using Videos to Evaluate Image Model Robustness
- Embodied Visual Recognition
- SampleAhead: Online Classifier-Sampler Communication for Learning from Synthesized Data
- MeshAdv: Adversarial Meshes for Visual Recognition