Scalable Differentiable Physics for Learning and Control

Abstract

Differentiable physics is a powerful approach to learning and control problems that involve physical objects and environments. While notable progress has been made, the capabilities of differentiable physics solvers remain limited. We develop a scalable framework for differentiable physics that can support a large number of objects and their interactions. To accommodate objects with arbitrary geometry and topology, we adopt meshes as our representation and leverage the sparsity of contacts for scalable differentiable collision handling. Collisions are resolved in localized regions to minimize the number of optimization variables even when the number of simulated objects is high. We further accelerate implicit differentiation of optimization with nonlinear constraints. Experiments demonstrate that the presented framework requires up to two orders of magnitude less memory and computation in comparison to recent particle-based methods. We further validate the approach on inverse problems and control scenarios, where it outperforms derivative-free and model-free baselines by at least an order of magnitude.

Cited by in corpus (16)

• DiffCloth: Differentiable Cloth Simulation with Dry Frictional Contact
• An End-to-End Differentiable Framework for Contact-Aware Robot Design
• DiffAqua: A Differentiable Computational Design Pipeline for Soft Underwater Swimmers with Shape Interpolation
• Multiscale Deep Equilibrium Models
• gradSim: Differentiable simulation for system identification and visuomotor control
• Fast and Feature-Complete Differentiable Physics for Articulated Rigid Bodies with Contact
• PlasticineLab: A Soft-Body Manipulation Benchmark with Differentiable Physics
• DiffSDFSim: Differentiable Rigid-Body Dynamics With Implicit Shapes
• Differentiable Simulation of Soft Multi-body Systems
• Ivy: Templated Deep Learning for Inter-Framework Portability
• A global convergence theory for deep ReLU implicit networks via over-parameterization
• Vision-based system identification and 3D keypoint discovery using dynamics constraints
• Faster Policy Learning with Continuous-Time Gradients
• Differentiable Spline Approximations
• Additive manufacturing process design with differentiable simulations
• A Differentiable Recipe for Learning Visual Non-Prehensile Planar Manipulation