A User's Guide to Calibrating Robotics Simulators
arXiv:2011.08985
Abstract
Simulators are a critical component of modern robotics research. Strategies for both perception and decision making can be studied in simulation first before deployed to real world systems, saving on time and costs. Despite significant progress on the development of sim-to-real algorithms, the analysis of different methods is still conducted in an ad-hoc manner, without a consistent set of tests and metrics for comparison. This paper fills this gap and proposes a set of benchmarks and a framework for the study of various algorithms aimed to transfer models and policies learnt in simulation to the real world. We conduct experiments on a wide range of well known simulated environments to characterize and offer insights into the performance of different algorithms. Our analysis can be useful for practitioners working in this area and can help make informed choices about the behavior and main properties of sim-to-real algorithms. We open-source the benchmark, training data, and trained models, which can be found at https://github.com/NVlabs/sim-parameter-estimation.
arXiv commentAccepted at Conference on Robot Learning 2020
References in corpus (10)
- PyTorch: An Imperative Style, High-Performance Deep Learning Library
- Continuous control with deep reinforcement learning
- Addressing Function Approximation Error in Actor-Critic Methods
- On First-Order Meta-Learning Algorithms
- Efficient Off-Policy Meta-Reinforcement Learning via Probabilistic Context Variables
- Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real World
- Multi-Goal Reinforcement Learning: Challenging Robotics Environments and Request for Research
- Assessing Transferability from Simulation to Reality for Reinforcement Learning
- Behaviour Suite for Reinforcement Learning
- Benchmarking Simulated Robotic Manipulation through a Real World Dataset