An Application-Driven Conceptualization of Corner Cases for Perception in Highly Automated Driving

Abstract

Systems and functions that rely on machine learning (ML) are the basis of highly automated driving. An essential task of such ML models is to reliably detect and interpret unusual, new, and potentially dangerous situations. The detection of those situations, which we refer to as corner cases, is highly relevant for successfully developing, applying, and validating automotive perception functions in future vehicles where multiple sensor modalities will be used. A complication for the development of corner case detectors is the lack of consistent definitions, terms, and corner case descriptions, especially when taking into account various automotive sensors. In this work, we provide an application-driven view of corner cases in highly automated driving. To achieve this goal, we first consider existing definitions from the general outlier, novelty, anomaly, and out-of-distribution detection to show relations and differences to corner cases. Moreover, we extend an existing camera-focused systematization of corner cases by adding RADAR (radio detection and ranging) and LiDAR (light detection and ranging) sensors. For this, we describe an exemplary toolchain for data acquisition and processing, highlighting the interfaces of the corner case detection. We also define a novel level of corner cases, the method layer corner cases, which appear due to uncertainty inherent in the methodology or the data distribution.

arXiv commentThis paper is submitted to IEEE Intelligent Vehicles Symposium 2021

References in corpus (10)

• What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?
• Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challenges
• The EuroCity Persons Dataset: A Novel Benchmark for Object Detection
• A2D2: Audi Autonomous Driving Dataset
• 2D Car Detection in Radar Data with PointNets
• The Fishyscapes Benchmark: Measuring Blind Spots in Semantic Segmentation
• Evaluating Bayesian Deep Learning Methods for Semantic Segmentation
• Real Time Lidar and Radar High-Level Fusion for Obstacle Detection and Tracking with evaluation on a ground truth
• Corner Cases for Visual Perception in Automated Driving: Some Guidance on Detection Approaches
• Identifying Unknown Instances for Autonomous Driving

Cited by in corpus (4)

• Anomaly Detection in Autonomous Driving: A Survey
• Description of Corner Cases in Automated Driving: Goals and Challenges
• One Ontology to Rule Them All: Corner Case Scenarios for Autonomous Driving
• Reliving the Dataset: Combining the Visualization of Road Users' Interactions with Scenario Reconstruction in Virtual Reality