CooTest: An Automated Testing Approach for V2X Communication Systems
arXiv:2408.16470 · doi:10.1145/3650212.3680373
Abstract
Perceiving the complex driving environment precisely is crucial to the safe operation of autonomous vehicles. With the tremendous advancement of deep learning and communication technology, Vehicle-to-Everything (V2X) collaboration has the potential to address limitations in sensing distant objects and occlusion for a single-agent perception system. However, despite spectacular progress, several communication challenges can undermine the effectiveness of multi-vehicle cooperative perception. The low interpretability of Deep Neural Networks (DNNs) and the high complexity of communication mechanisms make conventional testing techniques inapplicable for the cooperative perception of autonomous driving systems (ADS). Besides, the existing testing techniques, depending on manual data collection and labeling, become time-consuming and prohibitively expensive. In this paper, we design and implement CooTest, the first automated testing tool of the V2X-oriented cooperative perception module. CooTest devises the V2X-specific metamorphic relation and equips communication and weather transformation operators that can reflect the impact of the various cooperative driving factors to produce transformed scenes. Furthermore, we adopt a V2X-oriented guidance strategy for the transformed scene generation process and improve testing efficiency. We experiment CooTest with multiple cooperative perception models with different fusion schemes to evaluate its performance on different tasks. The experiment results show that CooTest can effectively detect erroneous behaviors under various V2X-oriented driving conditions. Also, the results confirm that CooTest can improve detection average precision and decrease misleading cooperation errors by retraining with the generated scenes.
References in corpus (10)
- A Survey of Autonomous Driving: Common Practices and Emerging Technologies
- Lidar for Autonomous Driving: The principles, challenges, and trends for automotive lidar and perception systems
- Milestones in Autonomous Driving and Intelligent Vehicles: Survey of Surveys
- Weather Influence and Classification with Automotive Lidar Sensors
- Collaborative Perception in Autonomous Driving: Methods, Datasets and Challenges
- Learning for Vehicle-to-Vehicle Cooperative Perception under Lossy Communication
- Benchmarking Robustness of AI-Enabled Multi-sensor Fusion Systems: Challenges and Opportunities
- Towards Vehicle-to-everything Autonomous Driving: A Survey on Collaborative Perception
- Collaborative Perception for Connected and Autonomous Driving: Challenges, Possible Solutions and Opportunities
- Common Corruption Robustness of Point Cloud Detectors: Benchmark and Enhancement