Virtual to Real Reinforcement Learning for Autonomous Driving
arXiv:1704.03952
Abstract
Reinforcement learning is considered as a promising direction for driving policy learning. However, training autonomous driving vehicle with reinforcement learning in real environment involves non-affordable trial-and-error. It is more desirable to first train in a virtual environment and then transfer to the real environment. In this paper, we propose a novel realistic translation network to make model trained in virtual environment be workable in real world. The proposed network can convert non-realistic virtual image input into a realistic one with similar scene structure. Given realistic frames as input, driving policy trained by reinforcement learning can nicely adapt to real world driving. Experiments show that our proposed virtual to real (VR) reinforcement learning (RL) works pretty well. To our knowledge, this is the first successful case of driving policy trained by reinforcement learning that can adapt to real world driving data.
References in corpus (13)
- Continuous control with deep reinforcement learning
- End to End Learning for Self-Driving Cars
- Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling
- The Cityscapes Dataset for Semantic Urban Scene Understanding
- DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs
- Autoencoding beyond pixels using a learned similarity metric
- Safe, Multi-Agent, Reinforcement Learning for Autonomous Driving
- Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real World
- Transfer from Simulation to Real World through Learning Deep Inverse Dynamics Model
- DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving
- End-to-End Deep Reinforcement Learning for Lane Keeping Assist
- Query-Efficient Imitation Learning for End-to-End Autonomous Driving
- End-to-end Learning of Driving Models from Large-scale Video Datasets
Cited by in corpus (49)
- An Introduction to Deep Reinforcement Learning
- A review of domain adaptation without target labels
- A Survey of End-to-End Driving: Architectures and Training Methods
- One-Shot Imitation from Observing Humans via Domain-Adaptive Meta-Learning
- Machine Learning Testing: Survey, Landscapes and Horizons
- Learning to Walk in the Real World with Minimal Human Effort
- A Survey of Deep Network Solutions for Learning Control in Robotics: From Reinforcement to Imitation
- Empowering Things with Intelligence: A Survey of the Progress, Challenges, and Opportunities in Artificial Intelligence of Things
- Yes, we GAN: Applying Adversarial Techniques for Autonomous Driving
- Deep Reinforcement Learning for Autonomous Driving
- Robust Deep Reinforcement Learning against Adversarial Perturbations on State Observations
- OpenStreetMap-based Autonomous Navigation With LiDAR Naive-Valley-Path Obstacle Avoidance
- Predicting drag on rough surfaces by transfer learning of empirical correlations
- Autonomous Driving in Reality with Reinforcement Learning and Image Translation
- Improving Generalization of Transfer Learning Across Domains Using Spatio-Temporal Features in Autonomous Driving
- DeepRacing: Parameterized Trajectories for Autonomous Racing
- Fever Basketball: A Complex, Flexible, and Asynchronized Sports Game Environment for Multi-agent Reinforcement Learning
- Latent Space Reinforcement Learning for Steering Angle Prediction
- Safe Reinforcement Learning for Autonomous Vehicles through Parallel Constrained Policy Optimization
- Hierarchical Policy for Non-prehensile Multi-object Rearrangement with Deep Reinforcement Learning and Monte Carlo Tree Search
- Two-stage Deep Reinforcement Learning for Inverter-based Volt-VAR Control in Active Distribution Networks
- A Survey of Deep Reinforcement Learning Algorithms for Motion Planning and Control of Autonomous Vehicles
- Domain Adaptation In Reinforcement Learning Via Latent Unified State Representation
- Reinforcement Learning based Control of Imitative Policies for Near-Accident Driving
- Modular Vehicle Control for Transferring Semantic Information Between Weather Conditions Using GANs
- Driving Experience Transfer Method for End-to-End Control of Self-Driving Cars
- PhysGAN: Generating Physical-World-Resilient Adversarial Examples for Autonomous Driving
- End-to-end Interpretable Neural Motion Planner
- Relationship Explainable Multi-objective Reinforcement Learning with Semantic Explainability Generation
- CIRL: Controllable Imitative Reinforcement Learning for Vision-based Self-driving
- Relationship Explainable Multi-objective Optimization Via Vector Value Function Based Reinforcement Learning
- Learning to Navigate from Simulation via Spatial and Semantic Information Synthesis with Noise Model Embedding
- Auto-Agent-Distiller: Towards Efficient Deep Reinforcement Learning Agents via Neural Architecture Search
- WAD: A Deep Reinforcement Learning Agent for Urban Autonomous Driving
- SENTINEL: Taming Uncertainty with Ensemble-based Distributional Reinforcement Learning
- A coevolutionary approach to deep multi-agent reinforcement learning
- Transfer Learning and Organic Computing for Autonomous Vehicles
- Integrating Imitation Learning with Human Driving Data into Reinforcement Learning to Improve Training Efficiency for Autonomous Driving
- A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learning
- Instance-Aware Predictive Navigation in Multi-Agent Environments
- Playing optical tweezers with deep reinforcement learning: in virtual, physical and augmented environments
- Partially fake it till you make it: mixing real and fake thermal images for improved object detection
- Curiosity Killed or Incapacitated the Cat and the Asymptotically Optimal Agent
- cGANs for Cartoon to Real-life Images
- Mutation Testing framework for Machine Learning
- Imitation Learning Approach for AI Driving Olympics Trained on Real-world and Simulation Data Simultaneously
- Enhanced Transfer Learning for Autonomous Driving with Systematic Accident Simulation
- A Virtual Testbed for Critical Incident Investigation with Autonomous Remote Aerial Vehicle Surveying, Artificial Intelligence, and Decision Support
- Towards a Sample Efficient Reinforcement Learning Pipeline for Vision Based Robotics