Follow the Gradient: Crossing the Reality Gap using Differentiable Physics (RealityGrad)
arXiv:2109.04674
Abstract
We propose a novel iterative approach for crossing the reality gap that utilises live robot rollouts and differentiable physics. Our method, RealityGrad, demonstrates for the first time, an efficient sim2real transfer in combination with a real2sim model optimisation for closing the reality gap. Differentiable physics has become an alluring alternative to classical rigid-body simulation due to the current culmination of automatic differentiation libraries, compute and non-linear optimisation libraries. Our method builds on this progress and employs differentiable physics for efficient trajectory optimisation. We demonstrate RealitGrad on a dynamic control task for a serial link robot manipulator and present results that show its efficiency and ability to quickly improve not just the robot's performance in real world tasks but also enhance the simulation model for future tasks. One iteration of RealityGrad takes less than 22 minutes on a desktop computer while reducing the error by 2/3, making it efficient compared to other sim2real methods in both compute and time. Our methodology and application of differentiable physics establishes a promising approach for crossing the reality gap and has great potential for scaling to complex environments.
arXiv comment8 Pages
References in corpus (7)
- Solving Rubik's Cube with a Robot Hand
- Whole-Body Nonlinear Model Predictive Control Through Contacts for Quadrupeds
- The Control Toolbox - An Open-Source C++ Library for Robotics, Optimal and Model Predictive Control
- gradSim: Differentiable simulation for system identification and visuomotor control
- Perspectives on Sim2Real Transfer for Robotics: A Summary of the R:SS 2020 Workshop
- Interactive Differentiable Simulation
- Auto-Tuned Sim-to-Real Transfer