Testing Scenario Library Generation for Connected and Automated Vehicles, Part I: Methodology

Abstract

Testing and evaluation is a critical step in the development and deployment of connected and automated vehicles (CAVs), and yet there is no systematic framework to generate testing scenario library. This study aims to provide a general framework for the testing scenario library generation (TSLG) problem with different operational design domains (ODDs), CAV models, and performance metrics. Given an ODD, the testing scenario library is defined as a critical set of scenarios that can be used for CAV test. Each testing scenario is evaluated by a newly proposed measure, scenario criticality, which can be computed as a combination of maneuver challenge and exposure frequency. To search for critical scenarios, an auxiliary objective function is designed, and a multi-start optimization method along with seed-filling is applied. The proposed framework is theoretically proved to obtain accurate evaluation results with much fewer number of tests, if compared with the on-road test method. In part II of the study, three case studies are investigated to demonstrate the proposed methodologies. Reinforcement learning based technique is applied to enhance the searching method under high-dimensional scenarios.

11 pages,3 figures

References in corpus (2)

• Testing Scenario Library Generation for Connected and Automated Vehicles, Part II: Case Studies
• An Unsupervised Random Forest Clustering Technique for Automatic Traffic Scenario Categorization

Cited by in corpus (23)

• Milestones in Autonomous Driving and Intelligent Vehicles Part I: Control, Computing System Design, Communication, HD Map, Testing, and Human Behaviors
• Testing Scenario Library Generation for Connected and Automated Vehicles, Part II: Case Studies
• Testing Scenario Library Generation for Connected and Automated Vehicles: An Adaptive Framework
• Scenario Parameter Generation Method and Scenario Representativeness Metric for Scenario-Based Assessment of Automated Vehicles
• Coverage based testing for V&V and Safety Assurance of Self-driving Autonomous Vehicles: A Systematic Literature Review
• Towards Guaranteed Safety Assurance of Automated Driving Systems with Scenario Sampling: An Invariant Set Perspective (Extended Version)
• Finding Critical Scenarios for Automated Driving Systems: A Systematic Literature Review
• Distributionally Consistent Simulation of Naturalistic Driving Environment for Autonomous Vehicle Testing
• PEM: Perception Error Model for Virtual Testing of Autonomous Vehicles
• Adaptive Safety Evaluation for Connected and Automated Vehicles with Sparse Control Variates
• Adversarial Evaluation of Autonomous Vehicles in Lane-Change Scenarios
• A Finite-Sampling, Operational Domain Specific, and Provably Unbiased Connected and Automated Vehicle Safety Metric
• On the Adversarial Scenario-based Safety Testing of Robots: the Comparability and Optimal Aggressiveness
• Specification-Guided Critical Scenario Identification for Automated Driving
• HAD-Gen: Human-like and Diverse Driving Behavior Modeling for Controllable Scenario Generation
• Scenario-based assessment of automated driving systems: How (not) to parameterize scenarios?
• Active sampling: A machine-learning-assisted framework for finite population inference with optimal subsamples
• Few-Shot Scenario Testing for Autonomous Vehicles Based on Neighborhood Coverage and Similarity
• Real-world Troublemaker: A 5G Cloud-controlled Track Testing Framework for Automated Driving Systems in Safety-critical Interaction Scenarios
• Corner Case Generation and Analysis for Safety Assessment of Autonomous Vehicles
• A Learning-based Stochastic Driving Model for Autonomous Vehicle Testing
• Make Full Use of Testing Information: An Integrated Accelerated Testing and Evaluation Method for Autonomous Driving Systems
• A Modeled Approach for Online Adversarial Test of Operational Vehicle Safety (extended version)