Circus ANYmal: A Quadruped Learning Dexterous Manipulation with Its Limbs
arXiv:2011.08811
Abstract
Quadrupedal robots are skillful at locomotion tasks while lacking manipulation skills, not to mention dexterous manipulation abilities. Inspired by the animal behavior and the duality between multi-legged locomotion and multi-fingered manipulation, we showcase a circus ball challenge on a quadrupedal robot, ANYmal. We employ a model-free reinforcement learning approach to train a deep policy that enables the robot to balance and manipulate a light-weight ball robustly using its limbs without any contact measurement sensor. The policy is trained in the simulation, in which we randomize many physical properties with additive noise and inject random disturbance force during manipulation, and achieves zero-shot deployment on the real robot without any adjustment. In the hardware experiments, dynamic performance is achieved with a maximum rotation speed of 15 deg/s, and robust recovery is showcased under external poking. To our best knowledge, it is the first work that demonstrates the dexterous dynamic manipulation on a real quadrupedal robot.
References in corpus (11)
- Learning agile and dynamic motor skills for legged robots
- DeepMimic: Example-Guided Deep Reinforcement Learning of Physics-Based Character Skills
- Solving Rubik's Cube with a Robot Hand
- Distributed Distributional Deterministic Policy Gradients
- Multi-Goal Reinforcement Learning: Challenging Robotics Environments and Request for Research
- Sim-to-Real: Learning Agile Locomotion For Quadruped Robots
- Learning to Walk in the Real World with Minimal Human Effort
- Learning a Contact-Adaptive Controller for Robust, Efficient Legged Locomotion
- Robust Recovery Controller for a Quadrupedal Robot using Deep Reinforcement Learning
- Optimisation of Body-ground Contact for Augmenting Whole-Body Loco-manipulation of Quadruped Robots
- Dynamic Legged Manipulation of a Ball Through Multi-Contact Optimization