Lifelong Vehicle Trajectory Prediction Framework Based on Generative Replay

Abstract

Accurate trajectory prediction of vehicles is essential for reliable autonomous driving. To maintain consistent performance as a vehicle driving around different cities, it is crucial to adapt to changing traffic circumstances and achieve lifelong trajectory prediction model. To realize it, catastrophic forgetting is a main problem to be addressed. In this paper, a divergence measurement method based on conditional Kullback-Leibler divergence is proposed first to evaluate spatiotemporal dependency difference among varied driving circumstances. Then based on generative replay, a novel lifelong vehicle trajectory prediction framework is developed. The framework consists of a conditional generation model and a vehicle trajectory prediction model. The conditional generation model is a generative adversarial network conditioned on position configuration of vehicles. After learning and merging trajectory distribution of vehicles across different cities, the generation model replays trajectories with prior samplings as inputs, which alleviates catastrophic forgetting. The vehicle trajectory prediction model is trained by the replayed trajectories and achieves consistent prediction performance on visited cities. A lifelong experiment setup is established on four open datasets including five tasks. Spatiotemporal dependency divergence is calculated for different tasks. Even though these divergence, the proposed framework exhibits lifelong learning ability and achieves consistent performance on all tasks.

arXiv comment12pages,7 figures

References in corpus (17)

• Adam: A Method for Stochastic Optimization
• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• Overcoming catastrophic forgetting in neural networks
• A continual learning survey: Defying forgetting in classification tasks
• NIPS 2016 Tutorial: Generative Adversarial Networks
• PathNet: Evolution Channels Gradient Descent in Super Neural Networks
• Gradient Episodic Memory for Continual Learning
• How would surround vehicles move? A Unified Framework for Maneuver Classification and Motion Prediction
• INTERACTION Dataset: An INTERnational, Adversarial and Cooperative moTION Dataset in Interactive Driving Scenarios with Semantic Maps
• Continual Learning with Deep Generative Replay
• Generative replay with feedback connections as a general strategy for continual learning
• Deep Generative Dual Memory Network for Continual Learning
• Injecting Knowledge in Data-driven Vehicle Trajectory Predictors
• Memory Replay GANs: learning to generate images from new categories without forgetting
• Joint Interaction and Trajectory Prediction for Autonomous Driving using Graph Neural Networks
• Learning Kernel for Conditional Moment-Matching Discrepancy-based Image Classification
• Multi-modal anticipation of stochastic trajectories in a dynamic environment with Conditional Variational Autoencoders