Expert-LaSTS: Expert-Knowledge Guided Latent Space for Traffic Scenarios

Abstract

Clustering traffic scenarios and detecting novel scenario types are required for scenario-based testing of autonomous vehicles. These tasks benefit from either good similarity measures or good representations for the traffic scenarios. In this work, an expert-knowledge aided representation learning for traffic scenarios is presented. The latent space so formed is used for successful clustering and novel scenario type detection. Expert-knowledge is used to define objectives that the latent representations of traffic scenarios shall fulfill. It is presented, how the network architecture and loss is designed from these objectives, thereby incorporating expert-knowledge. An automatic mining strategy for traffic scenarios is presented, such that no manual labeling is required. Results show the performance advantage compared to baseline methods. Additionally, extensive analysis of the latent space is performed.

arXiv commentCopyright 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

References in corpus (9)

• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
• FaceNet: A Unified Embedding for Face Recognition and Clustering
• UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
• Clustering of Driving Encounter Scenarios Using Connected Vehicle Trajectories
• An Unsupervised Random Forest Clustering Technique for Automatic Traffic Scenario Categorization
• Unsupervised and Supervised Learning with the Random Forest Algorithm for Traffic Scenario Clustering and Classification
• Deep Representation Learning and Clustering of Traffic Scenarios
• Novelty Detection and Analysis of Traffic Scenario Infrastructures in the Latent Space of a Vision Transformer-Based Triplet Autoencoder
• An Entropy Based Outlier Score and its Application to Novelty Detection for Road Infrastructure Images