Learning Free Gait Transition for Quadruped Robots via Phase-Guided Controller

Abstract

Gaits and transitions are key components in legged locomotion. For legged robots, describing and reproducing gaits as well as transitions remain longstanding challenges. Reinforcement learning has become a powerful tool to formulate controllers for legged robots. Learning multiple gaits and transitions, nevertheless, is related to the multi-task learning problems. In this work, we present a novel framework for training a simple control policy for a quadruped robot to locomote in various gaits. Four independent phases are used as the interface between the gait generator and the control policy, which characterizes the movement of four feet. Guided by the phases, the quadruped robot is able to locomote according to the generated gaits, such as walk, trot, pacing and bounding, and to make transitions among those gaits. More general phases can be used to generate complex gaits, such as mixed rhythmic dancing. With the control policy, the Black Panther robot, a medium-dog-sized quadruped robot, can perform all learned motor skills while following the velocity commands smoothly and robustly in natural environment.

arXiv commentAccepted by IEEE Robotics and Automation Letters: https://ieeexplore.ieee.org/document/9656601

References in corpus (9)

• Learning agile and dynamic motor skills for legged robots
• Learning Quadrupedal Locomotion over Challenging Terrain
• DeepMimic: Example-Guided Deep Reinforcement Learning of Physics-Based Character Skills
• Highly Dynamic Quadruped Locomotion via Whole-Body Impulse Control and Model Predictive Control
• Multi-expert learning of adaptive legged locomotion
• RLOC: Terrain-Aware Legged Locomotion using Reinforcement Learning and Optimal Control
• MCP: Learning Composable Hierarchical Control with Multiplicative Compositional Policies
• MPC-Net: A First Principles Guided Policy Search
• CARL: Controllable Agent with Reinforcement Learning for Quadruped Locomotion

Cited by in corpus (4)

• Robust High-speed Running for Quadruped Robots via Deep Reinforcement Learning
• RL + Model-based Control: Using On-demand Optimal Control to Learn Versatile Legged Locomotion
• Optimal Gait Control for a Tendon-driven Soft Quadruped Robot by Model-based Reinforcement Learning
• Energy-Efficient Omnidirectional Locomotion for Wheeled Quadrupeds via Predictive Energy-Aware Nominal Gait Selection