Perception Simplex: Verifiable Collision Avoidance in Autonomous Vehicles Amidst Obstacle Detection Faults
arXiv:2209.01710 · doi:10.1002/stvr.1879
Abstract
Advances in deep learning have revolutionized cyber-physical applications, including the development of Autonomous Vehicles. However, real-world collisions involving autonomous control of vehicles have raised significant safety concerns regarding the use of Deep Neural Networks (DNN) in safety-critical tasks, particularly Perception. The inherent unverifiability of DNNs poses a key challenge in ensuring their safe and reliable operation. In this work, we propose Perception Simplex (PS), a fault-tolerant application architecture designed for obstacle detection and collision avoidance. We analyze an existing LiDAR-based classical obstacle detection algorithm to establish strict bounds on its capabilities and limitations. Such analysis and verification have not been possible for deep learning-based perception systems yet. By employing verifiable obstacle detection algorithms, PS identifies obstacle existence detection faults in the output of unverifiable DNN-based object detectors. When faults with potential collision risks are detected, appropriate corrective actions are initiated. Through extensive analysis and software-in-the-loop simulations, we demonstrate that PS provides predictable and deterministic fault tolerance against obstacle existence detection faults, establishing a robust safety guarantee.
arXiv admin note: substantial text overlap with arXiv:2208.14403
References in corpus (7)
- Lidar for Autonomous Driving: The principles, challenges, and trends for automotive lidar and perception systems
- Ethical Decision Making During Automated Vehicle Crashes
- A Benchmark for Lidar Sensors in Fog: Is Detection Breaking Down?
- How to Certify Machine Learning Based Safety-critical Systems? A Systematic Literature Review
- Risk Ranked Recall: Collision Safety Metric for Object Detection Systems in Autonomous Vehicles
- Verifiable Obstacle Detection
- Synergistic Perception and Control Simplex for Verifiable Safe Vertical Landing