Deep Learning-based Vehicle Behaviour Prediction For Autonomous Driving Applications: A Review

Abstract

Behaviour prediction function of an autonomous vehicle predicts the future states of the nearby vehicles based on the current and past observations of the surrounding environment. This helps enhance their awareness of the imminent hazards. However, conventional behaviour prediction solutions are applicable in simple driving scenarios that require short prediction horizons. Most recently, deep learning-based approaches have become popular due to their superior performance in more complex environments compared to the conventional approaches. Motivated by this increased popularity, we provide a comprehensive review of the state-of-the-art of deep learning-based approaches for vehicle behaviour prediction in this paper. We firstly give an overview of the generic problem of vehicle behaviour prediction and discuss its challenges, followed by classification and review of the most recent deep learning-based solutions based on three criteria: input representation, output type, and prediction method. The paper also discusses the performance of several well-known solutions, identifies the research gaps in the literature and outlines potential new research directions.

References in corpus (17)

• Semi-Supervised Classification with Graph Convolutional Networks
• Social Force Model for Pedestrian Dynamics
• WaveNet: A Generative Model for Raw Audio
• An Overview of Multi-Task Learning in Deep Neural Networks
• Skip-Thought Vectors
• Human Motion Trajectory Prediction: A Survey
• Multi-Modal Trajectory Prediction of Surrounding Vehicles with Maneuver based LSTMs
• Fast and Furious: Real Time End-to-End 3D Detection, Tracking and Motion Forecasting with a Single Convolutional Net
• IntentNet: Learning to Predict Intention from Raw Sensor Data
• Neural Machine Translation and Sequence-to-sequence Models: A Tutorial
• GRIP++: Enhanced Graph-based Interaction-aware Trajectory Prediction for Autonomous Driving
• TrafficPredict: Trajectory Prediction for Heterogeneous Traffic-Agents
• Survey on Vision-based Path Prediction
• Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networks
• Predicting Vehicle Behaviors Over An Extended Horizon Using Behavior Interaction Network
• Online Vehicle Trajectory Prediction using Policy Anticipation Network and Optimization-based Context Reasoning
• Naturalistic Driver Intention and Path Prediction using Recurrent Neural Networks

Cited by in corpus (38)

• Milestones in Autonomous Driving and Intelligent Vehicles: Survey of Surveys
• A Review on Deep Learning Techniques for Video Prediction
• Graph-Based Spatial-Temporal Convolutional Network for Vehicle Trajectory Prediction in Autonomous Driving
• Social Interactions for Autonomous Driving: A Review and Perspectives
• Early Lane Change Prediction for Automated Driving Systems Using Multi-Task Attention-based Convolutional Neural Networks
• NetTraj: A Network-based Vehicle Trajectory Prediction Model with Directional Representation and Spatiotemporal Attention Mechanisms
• From SLAM to Situational Awareness: Challenges and Survey
• LC-LLM: Explainable Lane-Change Intention and Trajectory Predictions with Large Language Models
• Spartus: A 9.4 TOp/s FPGA-based LSTM Accelerator Exploiting Spatio-Temporal Sparsity
• Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions
• Quantum Convolutional Neural Networks for Multi-Channel Supervised Learning
• Resilient Branching MPC for Multi-Vehicle Traffic Scenarios Using Adversarial Disturbance Sequences
• Beyond RMSE: Do machine-learned models of road user interaction produce human-like behavior?
• S4TP: Social-Suitable and Safety-Sensitive Trajectory Planning for Autonomous Vehicles
• Unveiling the frontiers of deep learning: innovations shaping diverse domains
• Statistical Hypothesis Testing Based on Machine Learning: Large Deviations Analysis
• Vision-based Multi-future Trajectory Prediction: A Survey
• Learning Interaction-aware Guidance Policies for Motion Planning in Dense Traffic Scenarios
• Deep Learning Methods for Vessel Trajectory Prediction based on Recurrent Neural Networks
• Short-term Inland Vessel Trajectory Prediction with Encoder-Decoder Models
• STrajNet: Multi-modal Hierarchical Transformer for Occupancy Flow Field Prediction in Autonomous Driving
• Benchmark for Models Predicting Human Behavior in Gap Acceptance Scenarios
• Comparing merging behaviors observed in naturalistic data with behaviors generated by a machine learned model
• Affordance-based Reinforcement Learning for Urban Driving
• Overview of AdaBoost : Reconciling its views to better understand its dynamics
• Learning Position From Vehicle Vibration Using an Inertial Measurement Unit
• Vehicle trajectory prediction in top-view image sequences based on deep learning method
• Motion Prediction on Self-driving Cars: A Review
• MoNet: Motion-based Point Cloud Prediction Network
• The Atlas of Lane Changes: Investigating Location-dependent Lane Change Behaviors Using Measurement Data from a Customer Fleet
• Spatial and social situation-aware transformer-based trajectory prediction of autonomous systems
• Pylot: A Modular Platform for Exploring Latency-Accuracy Tradeoffs in Autonomous Vehicles
• Trajectory Prediction with Graph-based Dual-scale Context Fusion
• Negotiation-Aware Reachability-Based Safety Verification for AutonomousDriving in Interactive Scenarios
• Querying Labeled Time Series Data with Scenario Programs
• Are you a robot? Detecting Autonomous Vehicles from Behavior Analysis
• A hierarchical behavior prediction framework at signalized intersections
• A Taxonomy and Review of Algorithms for Modeling and Predicting Human Driver Behavior