Weighted Average Precision: Adversarial Example Detection in the Visual Perception of Autonomous Vehicles
arXiv:2002.03751
Abstract
Recent works have shown that neural networks are vulnerable to carefully crafted adversarial examples (AE). By adding small perturbations to input images, AEs are able to make the victim model predicts incorrect outputs. Several research work in adversarial machine learning started to focus on the detection of AEs in autonomous driving. However, the existing studies either use preliminary assumption on outputs of detections or ignore the tracking system in the perception pipeline. In this paper, we firstly propose a novel distance metric for practical autonomous driving object detection outputs. Then, we bridge the gap between the current AE detection research and the real-world autonomous systems by providing a temporal detection algorithm, which takes the impact of tracking system into consideration. We perform evaluation on Berkeley Deep Drive (BDD) and CityScapes datasets to show how our approach outperforms existing single-frame-mAP based AE detections by increasing 17.76% accuracy of performance.
References in corpus (6)
- Towards Deep Neural Network Architectures Robust to Adversarial Examples
- Countering Adversarial Images using Input Transformations
- Enhancing Cross-task Transferability of Adversarial Examples with Dispersion Reduction
- Enhancing Cross-task Black-Box Transferability of Adversarial Examples with Dispersion Reduction
- Simulation of Real-time Routing for UAS traffic Management with Communication and Airspace Safety Considerations
- Autonomous Human Activity Classification from Ego-vision Camera and Accelerometer Data