A Mobile Manipulation System for One-Shot Teaching of Complex Tasks in Homes
arXiv:1910.00127
Abstract
We describe a mobile manipulation hardware and software system capable of autonomously performing complex human-level tasks in real homes, after being taught the task with a single demonstration from a person in virtual reality. This is enabled by a highly capable mobile manipulation robot, whole-body task space hybrid position/force control, teaching of parameterized primitives linked to a robust learned dense visual embeddings representation of the scene, and a task graph of the taught behaviors. We demonstrate the robustness of the approach by presenting results for performing a variety of tasks, under different environmental conditions, in multiple real homes. Our approach achieves 85% overall success rate on three tasks that consist of an average of 45 behaviors each.
The video is available at: https://youtu.be/HSyAGMGikLk. 7 pages, 5 figures, accepted by IEEE 2020 Robotics International Conference on Robotics and Automation (ICRA)
References in corpus (9)
- ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes
- Semantic Instance Segmentation with a Discriminative Loss Function
- One-Shot Visual Imitation Learning via Meta-Learning
- Deep Object Pose Estimation for Semantic Robotic Grasping of Household Objects
- Dense Object Nets: Learning Dense Visual Object Descriptors By and For Robotic Manipulation
- The Devil is in the Tails: Fine-grained Classification in the Wild
- Watch, Try, Learn: Meta-Learning from Demonstrations and Reward
- Visual-Inertial Teach and Repeat for Aerial Inspection
- One-Shot Learning of Manipulation Skills with Online Dynamics Adaptation and Neural Network Priors