Learning coordinated badminton skills for legged manipulators
arXiv:2505.22974 · doi:10.1126/scirobotics.adu3922
Abstract
Coordinating the motion between lower and upper limbs and aligning limb control with perception are substantial challenges in robotics, particularly in dynamic environments. To this end, we introduce an approach for enabling legged mobile manipulators to play badminton, a task that requires precise coordination of perception, locomotion, and arm swinging. We propose a unified reinforcement learning-based control policy for whole-body visuomotor skills involving all degrees of freedom to achieve effective shuttlecock tracking and striking. This policy is informed by a perception noise model that utilizes real-world camera data, allowing for consistent perception error levels between simulation and deployment and encouraging learned active perception behaviors. Our method includes a shuttlecock prediction model, constrained reinforcement learning for robust motion control, and integrated system identification techniques to enhance deployment readiness. Extensive experimental results in a variety of environments validate the robot's capability to predict shuttlecock trajectories, navigate the service area effectively, and execute precise strikes against human players, demonstrating the feasibility of using legged mobile manipulators in complex and dynamic sports scenarios.
Science Robotics DOI: 10.1126/scirobotics.adu3922
References in corpus (10)
- Learning agile and dynamic motor skills for legged robots
- Learning robust perceptive locomotion for quadrupedal robots in the wild
- Concurrent Training of a Control Policy and a State Estimator for Dynamic and Robust Legged Locomotion
- Learning Agile Soccer Skills for a Bipedal Robot with Deep Reinforcement Learning
- Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learning
- Optimizing Bipedal Locomotion for The 100m Dash With Comparison to Human Running
- Legged Locomotion in Challenging Terrains using Egocentric Vision
- Deep Whole-Body Control: Learning a Unified Policy for Manipulation and Locomotion
- HumanPlus: Humanoid Shadowing and Imitation from Humans
- Visual Whole-Body Control for Legged Loco-Manipulation