Efficient Latent Representations using Multiple Tasks for Autonomous Driving
arXiv:2003.00695
Abstract
Driving in the dynamic, multi-agent, and complex urban environment is a difficult task requiring a complex decision policy. The learning of such a policy requires a state representation that can encode the entire environment. Mid-level representations that encode a vehicle's environment as images have become a popular choice, but they are quite high-dimensional, which limits their use in data-scarce cases such as reinforcement learning. In this article, we propose to learn a low dimensional and rich feature representation of the environment by training an encoder-decoder deep neural network to predict multiple application relevant factors such as trajectories of other agents. We demonstrate that the use of the multi-head encoder-decoder neural network results in a more informative representation compared to a single-head encoder-decoder model. In particular, the proposed representation learning approach helps the policy network to learn faster, with increased performance and with less data, compared to existing approaches using a single-head network.
6 pages, 8 figures, submitted to IROS 2020
References in corpus (6)
- PyTorch: An Imperative Style, High-Performance Deep Learning Library
- End to End Learning for Self-Driving Cars
- Fast and Furious: Real Time End-to-End 3D Detection, Tracking and Motion Forecasting with a Single Convolutional Net
- MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Prediction
- Deep Imitation Learning for Autonomous Driving in Generic Urban Scenarios with Enhanced Safety
- End-to-end driving simulation via angle branched network