Adaptation of Quadruped Robot Locomotion with Meta-Learning

Abstract

Animals have remarkable abilities to adapt locomotion to different terrains and tasks. However, robots trained by means of reinforcement learning are typically able to solve only a single task and a transferred policy is usually inferior to that trained from scratch. In this work, we demonstrate that meta-reinforcement learning can be used to successfully train a robot capable to solve a wide range of locomotion tasks. The performance of the meta-trained robot is similar to that of a robot that is trained on a single task.

arXiv comment14 pages, 6 figures

References in corpus (26)

• Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor
• Stochastic Backpropagation and Approximate Inference in Deep Generative Models
• Addressing Function Approximation Error in Actor-Critic Methods
• Soft Actor-Critic Algorithms and Applications
• High-Dimensional Continuous Control Using Generalized Advantage Estimation
• QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulation
• Solving Rubik's Cube with a Robot Hand
• Deep Reinforcement Learning: An Overview
• RL${}^2$: Fast Reinforcement Learning via Slow Reinforcement Learning
• Deep Variational Information Bottleneck
• Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learning
• Learning Dexterous In-Hand Manipulation
• Efficient Off-Policy Meta-Reinforcement Learning via Probabilistic Context Variables
• Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real World
• Grasp2Vec: Learning Object Representations from Self-Supervised Grasping
• Deep Dynamics Models for Learning Dexterous Manipulation
• VariBAD: A Very Good Method for Bayes-Adaptive Deep RL via Meta-Learning
• Controlling Overestimation Bias with Truncated Mixture of Continuous Distributional Quantile Critics
• Active Domain Randomization
• Dexterous Manipulation with Deep Reinforcement Learning: Efficient, General, and Low-Cost
• Offline Meta-Reinforcement Learning with Advantage Weighting
• ROBEL: Robotics Benchmarks for Learning with Low-Cost Robots
• Emergent Real-World Robotic Skills via Unsupervised Off-Policy Reinforcement Learning
• Interferobot: aligning an optical interferometer by a reinforcement learning agent
• Auto-Tuned Sim-to-Real Transfer
• MELD: Meta-Reinforcement Learning from Images via Latent State Models