Learning a Driving Simulator
arXiv:1608.01230
Abstract
Comma.ai's approach to Artificial Intelligence for self-driving cars is based on an agent that learns to clone driver behaviors and plans maneuvers by simulating future events in the road. This paper illustrates one of our research approaches for driving simulation. One where we learn to simulate. Here we investigate variational autoencoders with classical and learned cost functions using generative adversarial networks for embedding road frames. Afterwards, we learn a transition model in the embedded space using action conditioned Recurrent Neural Networks. We show that our approach can keep predicting realistic looking video for several frames despite the transition model being optimized without a cost function in the pixel space.
Cited by in corpus (20)
- Motion Planning for Autonomous Driving: The State of the Art and Future Perspectives
- A Review on Generative Adversarial Networks: Algorithms, Theory, and Applications
- Self-Driving Car Steering Angle Prediction Based on Image Recognition
- End-to-End Deep Learning for Steering Autonomous Vehicles Considering Temporal Dependencies
- A Commute in Data: The comma2k19 Dataset
- Autonomous Driving with Deep Learning: A Survey of State-of-Art Technologies
- Geo-Context Aware Study of Vision-Based Autonomous Driving Models and Spatial Video Data
- Driving Datasets Literature Review
- Transfer learning from synthetic to real images using variational autoencoders for robotic applications
- Two-stream convolutional networks for end-to-end learning of self-driving cars
- DeepRacing: Parameterized Trajectories for Autonomous Racing
- SAD-GAN: Synthetic Autonomous Driving using Generative Adversarial Networks
- Improving Robustness of Learning-based Autonomous Steering Using Adversarial Images
- Fonts-2-Handwriting: A Seed-Augment-Train framework for universal digit classification
- A Methodological Review of Visual Road Recognition Procedures for Autonomous Driving Applications
- DDD20 End-to-End Event Camera Driving Dataset: Fusing Frames and Events with Deep Learning for Improved Steering Prediction
- Tackling Variabilities in Autonomous Driving
- Video Compression Coding via Colorization: A Generative Adversarial Network (GAN)-Based Approach
- Brain-Inspired Deep Imitation Learning for Autonomous Driving Systems
- CAN Coach: Vehicular Control through Human Cyber-Physical Systems