Deep Imitation Learning for Complex Manipulation Tasks from Virtual Reality Teleoperation
arXiv:1710.04615
Abstract
Imitation learning is a powerful paradigm for robot skill acquisition. However, obtaining demonstrations suitable for learning a policy that maps from raw pixels to actions can be challenging. In this paper we describe how consumer-grade Virtual Reality headsets and hand tracking hardware can be used to naturally teleoperate robots to perform complex tasks. We also describe how imitation learning can learn deep neural network policies (mapping from pixels to actions) that can acquire the demonstrated skills. Our experiments showcase the effectiveness of our approach for learning visuomotor skills.
First two authors contributed equally. Video available at https://sites.google.com/view/vrlfd/
Cited by in corpus (15)
- Human Intention Estimation based on Hidden Markov Model Motion Validation for Safe Flexible Robotized Warehouses
- Imitation Learning Based on Bilateral Control for Human-Robot Cooperation
- SQIL: Imitation Learning via Reinforcement Learning with Sparse Rewards
- RoboTurk: A Crowdsourcing Platform for Robotic Skill Learning through Imitation
- Parrot: Data-Driven Behavioral Priors for Reinforcement Learning
- Learning Latent Plans from Play
- Graph-Structured Visual Imitation
- Neural Task Graphs: Generalizing to Unseen Tasks from a Single Video Demonstration
- Scaling Robot Supervision to Hundreds of Hours with RoboTurk: Robotic Manipulation Dataset through Human Reasoning and Dexterity
- Human-in-the-Loop Imitation Learning using Remote Teleoperation
- Hindsight Generative Adversarial Imitation Learning
- Imitation learning for variable speed motion generation over multiple actions
- Time Series Motion Generation Considering Long Short-Term Motion
- Learning to Play by Imitating Humans
- Continuous Control for High-Dimensional State Spaces: An Interactive Learning Approach