End-to-end Interpretable Neural Motion Planner

Abstract

In this paper, we propose a neural motion planner (NMP) for learning to drive autonomously in complex urban scenarios that include traffic-light handling, yielding, and interactions with multiple road-users. Towards this goal, we design a holistic model that takes as input raw LIDAR data and a HD map and produces interpretable intermediate representations in the form of 3D detections and their future trajectories, as well as a cost volume defining the goodness of each position that the self-driving car can take within the planning horizon. We then sample a set of diverse physically possible trajectories and choose the one with the minimum learned cost. Importantly, our cost volume is able to naturally capture multi-modality. We demonstrate the effectiveness of our approach in real-world driving data captured in several cities in North America. Our experiments show that the learned cost volume can generate safer planning than all the baselines.

CVPR 2019 (Oral)

References in corpus (10)

• MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
• End to End Learning for Self-Driving Cars
• Understanding the Effective Receptive Field in Deep Convolutional Neural Networks
• Fast and Furious: Real Time End-to-End 3D Detection, Tracking and Motion Forecasting with a Single Convolutional Net
• Pyramid Scene Parsing Network
• Maximum Entropy Deep Inverse Reinforcement Learning
• IntentNet: Learning to Predict Intention from Raw Sensor Data
• Baidu Apollo EM Motion Planner
• Virtual to Real Reinforcement Learning for Autonomous Driving
• Conditional Affordance Learning for Driving in Urban Environments