Learning to Fly via Deep Model-Based Reinforcement Learning
arXiv:2003.08876
Abstract
Learning to control robots without requiring engineered models has been a long-term goal, promising diverse and novel applications. Yet, reinforcement learning has only achieved limited impact on real-time robot control due to its high demand of real-world interactions. In this work, by leveraging a learnt probabilistic model of drone dynamics, we learn a thrust-attitude controller for a quadrotor through model-based reinforcement learning. No prior knowledge of the flight dynamics is assumed; instead, a sequential latent variable model, used generatively and as an online filter, is learnt from raw sensory input. The controller and value function are optimised entirely by propagating stochastic analytic gradients through generated latent trajectories. We show that "learning to fly" can be achieved with less than 30 minutes of experience with a single drone, and can be deployed solely using onboard computational resources and sensors, on a self-built drone.
References in corpus (16)
- Auto-Encoding Variational Bayes
- Continuous control with deep reinforcement learning
- Dueling Network Architectures for Deep Reinforcement Learning
- QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulation
- Solving Rubik's Cube with a Robot Hand
- Learning Continuous Control Policies by Stochastic Value Gradients
- Neural Lander: Stable Drone Landing Control using Learned Dynamics
- Deep Drone Racing: From Simulation to Reality with Domain Randomization
- Model-Based Value Estimation for Efficient Model-Free Reinforcement Learning
- A Disentangled Recognition and Nonlinear Dynamics Model for Unsupervised Learning
- Learning to Walk via Deep Reinforcement Learning
- Switching Linear Dynamics for Variational Bayes Filtering
- Neuroflight: Next Generation Flight Control Firmware
- Reactive Reinforcement Learning in Asynchronous Environments
- Real-Time Reinforcement Learning
- Teach-Repeat-Replan: A Complete and Robust System for Aggressive Flight in Complex Environments