Heterogeneous Trajectory Forecasting via Risk and Scene Graph Learning

Abstract

Heterogeneous trajectory forecasting is critical for intelligent transportation systems, but it is challenging because of the difficulty of modeling the complex interaction relations among the heterogeneous road agents as well as their agent-environment constraints. In this work, we propose a risk and scene graph learning method for trajectory forecasting of heterogeneous road agents, which consists of a Heterogeneous Risk Graph (HRG) and a Hierarchical Scene Graph (HSG) from the aspects of agent category and their movable semantic regions. HRG groups each kind of road agent and calculates their interaction adjacency matrix based on an effective collision risk metric. HSG of the driving scene is modeled by inferring the relationship between road agents and road semantic layout aligned by the road scene grammar. Based on this formulation, we can obtain effective trajectory forecasting in driving situations, and superior performance to other state-of-the-art approaches is demonstrated by exhaustive experiments on the nuScenes, ApolloScape, and Argoverse datasets.

arXiv commentaccepted by IEEE Transactions on Intelligent Transportation Systems, 2023

References in corpus (14)

• The ApolloScape Open Dataset for Autonomous Driving and its Application
• Universal power law governing pedestrian interactions
• Graph-Based Spatial-Temporal Convolutional Network for Vehicle Trajectory Prediction in Autonomous Driving
• TraPHic: Trajectory Prediction in Dense and Heterogeneous Traffic Using Weighted Interactions
• Stepwise Goal-Driven Networks for Trajectory Prediction
• EvolveGraph: Multi-Agent Trajectory Prediction with Dynamic Relational Reasoning
• GRIP++: Enhanced Graph-based Interaction-aware Trajectory Prediction for Autonomous Driving
• Latent Variable Sequential Set Transformers For Joint Multi-Agent Motion Prediction
• Multi-agent Trajectory Prediction with Fuzzy Query Attention
• Behavioral Intention Prediction in Driving Scenes: A Survey
• Unsupervised Traffic Scene Generation with Synthetic 3D Scene Graphs
• Cognitive Accident Prediction in Driving Scenes: A Multimodality Benchmark
• Scene Gated Social Graph: Pedestrian Trajectory Prediction Based on Dynamic Social Graphs and Scene Constraints
• Perceive, Interact, Predict: Learning Dynamic and Static Clues for End-to-End Motion Prediction

Cited by in corpus (2)

• Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions
• Trajectory prediction for heterogeneous agents: A performance analysis on small and imbalanced datasets