Learning Whole-body Motor Skills for Humanoids
arXiv:2002.02991 · doi:10.1109/HUMANOIDS.2018.8625045
Abstract
This paper presents a hierarchical framework for Deep Reinforcement Learning that acquires motor skills for a variety of push recovery and balancing behaviors, i.e., ankle, hip, foot tilting, and stepping strategies. The policy is trained in a physics simulator with realistic setting of robot model and low-level impedance control that are easy to transfer the learned skills to real robots. The advantage over traditional methods is the integration of high-level planner and feedback control all in one single coherent policy network, which is generic for learning versatile balancing and recovery motions against unknown perturbations at arbitrary locations (e.g., legs, torso). Furthermore, the proposed framework allows the policy to be learned quickly by many state-of-the-art learning algorithms. By comparing our learned results to studies of preprogrammed, special-purpose controllers in the literature, self-learned skills are comparable in terms of disturbance rejection but with additional advantages of producing a wide range of adaptive, versatile and robust behaviors.
arXiv comment2018 IEEE-RAS 18th International Conference on Humanoid Robots (Humanoids)
References in corpus (3)
Cited by in corpus (7)
- Multi-expert learning of adaptive legged locomotion
- Learning natural locomotion behaviors for humanoid robots using human knowledge
- Learning Bipedal Walking for Humanoids with Current Feedback
- Robust Task-Space Quadratic Programming for Kinematic-Controlled Robots
- On the Emergence of Whole-body Strategies from Humanoid Robot Push-recovery Learning
- Reactive Stepping for Humanoid Robots using Reinforcement Learning: Application to Standing Push Recovery on the Exoskeleton Atalante
- Deep Reinforcement Learning for Bipedal Locomotion: A Brief Survey