Cat-like Jumping and Landing of Legged Robots in Low-gravity Using Deep Reinforcement Learning

Abstract

In this article, we show that learned policies can be applied to solve legged locomotion control tasks with extensive flight phases, such as those encountered in space exploration. Using an off-the-shelf deep reinforcement learning algorithm, we trained a neural network to control a jumping quadruped robot while solely using its limbs for attitude control. We present tasks of increasing complexity leading to a combination of three-dimensional (re-)orientation and landing locomotion behaviors of a quadruped robot traversing simulated low-gravity celestial bodies. We show that our approach easily generalizes across these tasks and successfully trains policies for each case. Using sim-to-real transfer, we deploy trained policies in the real world on the SpaceBok robot placed on an experimental testbed designed for two-dimensional micro-gravity experiments. The experimental results demonstrate that repetitive, controlled jumping and landing with natural agility is possible.

arXiv commentPublished in IEEE Transactions on Robotics: https://ieeexplore.ieee.org/document/9453856 Video: https://youtu.be/KQhlZa42fe4

References in corpus (2)

• Learning agile and dynamic motor skills for legged robots
• Real-Time Motion Planning of Legged Robots: A Model Predictive Control Approach

Cited by in corpus (4)

• Scientific Exploration of Challenging Planetary Analog Environments with a Team of Legged Robots
• Deep Reinforcement Learning for Bipedal Locomotion: A Brief Survey
• Towards Safe Landing of Falling Quadruped Robots Using a 3-DoF Morphable Inertial Tail
• Central pattern generators evolved for real-time adaptation to rhythmic stimuli