Learn to Teach: Sample-Efficient Privileged Learning for Humanoid Locomotion over Diverse Terrains

Abstract

Humanoid robots promise transformative capabilities for industrial and service applications. While recent advances in Reinforcement Learning (RL) yield impressive results in locomotion, manipulation, and navigation, the proposed methods typically require enormous simulation samples to account for real-world variability. This work proposes a novel one-stage training framework-Learn to Teach (L2T)-which unifies teacher and student policy learning. Our approach recycles simulator samples and synchronizes the learning trajectories through shared dynamics, significantly reducing sample complexities and training time while achieving state-of-the-art performance. Furthermore, we validate the RL variant (L2T-RL) through extensive simulations and hardware tests on the Digit robot, demonstrating zero-shot sim-to-real transfer and robust performance over 12+ challenging terrains without depth estimation modules.

Accepted to IEEE Robotics and Automation Letters (RA-L)

References in corpus (5)

• Learning Quadrupedal Locomotion over Challenging Terrain
• Sim-to-Real Transfer of Robotic Control with Dynamics Randomization
• Learning robust perceptive locomotion for quadrupedal robots in the wild
• Orbit: A Unified Simulation Framework for Interactive Robot Learning Environments
• Learning Agile Soccer Skills for a Bipedal Robot with Deep Reinforcement Learning