Vehicle Trajectory Prediction by Transfer Learning of Semi-Supervised Models

Abstract

In this work we show that semi-supervised models for vehicle trajectory prediction significantly improve performance over supervised models on state-of-the-art real-world benchmarks. Moving from supervised to semi-supervised models allows scaling-up by using unlabeled data, increasing the number of images in pre-training from Millions to a Billion. We perform ablation studies comparing transfer learning of semi-supervised and supervised models while keeping all other factors equal. Within semi-supervised models we compare contrastive learning with teacher-student methods as well as networks predicting a small number of trajectories with networks predicting probabilities over a large trajectory set. Our results using both low-level and mid-level representations of the driving environment demonstrate the applicability of semi-supervised methods for real-world vehicle trajectory prediction.

References in corpus (8)

• Bootstrap your own latent: A new approach to self-supervised Learning
• End to End Learning for Self-Driving Cars
• Billion-scale semi-supervised learning for image classification
• MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Prediction
• Multiple Futures Prediction
• Spatially-Aware Graph Neural Networks for Relational Behavior Forecasting from Sensor Data
• End-to-end Multi-Modal Multi-Task Vehicle Control for Self-Driving Cars with Visual Perception
• Winning the ICCV 2019 Learning to Drive Challenge