Multimodal Detection of Unknown Objects on Roads for Autonomous Driving

Abstract

Tremendous progress in deep learning over the last years has led towards a future with autonomous vehicles on our roads. Nevertheless, the performance of their perception systems is strongly dependent on the quality of the utilized training data. As these usually only cover a fraction of all object classes an autonomous driving system will face, such systems struggle with handling the unexpected. In order to safely operate on public roads, the identification of objects from unknown classes remains a crucial task. In this paper, we propose a novel pipeline to detect unknown objects. Instead of focusing on a single sensor modality, we make use of lidar and camera data by combining state-of-the art detection models in a sequential manner. We evaluate our approach on the Waymo Open Perception Dataset and point out current research gaps in anomaly detection.

Daniel Bogdoll, Enrico Eisen, Maximilian Nitsche, and Christin Scheib contributed equally. Accepted for publication at SMC 2022

References in corpus (8)

• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
• On Calibration of Modern Neural Networks
• High-Resolution Representations for Labeling Pixels and Regions
• Anomaly Detection in Autonomous Driving: A Survey
• One Million Scenes for Autonomous Driving: ONCE Dataset
• Description of Corner Cases in Automated Driving: Goals and Challenges
• Taxonomy and Survey on Remote Human Input Systems for Driving Automation Systems
• Ad-datasets: a meta-collection of data sets for autonomous driving

Cited by in corpus (2)

• Perception Datasets for Anomaly Detection in Autonomous Driving: A Survey
• Mcity Data Engine: Iterative Model Improvement Through Open-Vocabulary Data Selection