LiRaNet: End-to-End Trajectory Prediction using Spatio-Temporal Radar Fusion
arXiv:2010.00731
Abstract
In this paper, we present LiRaNet, a novel end-to-end trajectory prediction method which utilizes radar sensor information along with widely used lidar and high definition (HD) maps. Automotive radar provides rich, complementary information, allowing for longer range vehicle detection as well as instantaneous radial velocity measurements. However, there are factors that make the fusion of lidar and radar information challenging, such as the relatively low angular resolution of radar measurements, their sparsity and the lack of exact time synchronization with lidar. To overcome these challenges, we propose an efficient spatio-temporal radar feature extraction scheme which achieves state-of-the-art performance on multiple large-scale datasets.Further, by incorporating radar information, we show a 52% reduction in prediction error for objects with high acceleration and a 16% reduction in prediction error for objects at longer range.
Accepted to Conference on Robot Learning (CoRL) 2020
References in corpus (6)
- Deep Continuous Fusion for Multi-Sensor 3D Object Detection
- Fast and Furious: Real Time End-to-End 3D Detection, Tracking and Motion Forecasting with a Single Convolutional Net
- IntentNet: Learning to Predict Intention from Raw Sensor Data
- MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Prediction
- Multiple Futures Prediction
- Spatially-Aware Graph Neural Networks for Relational Behavior Forecasting from Sensor Data