Learning Generalizable Physical Dynamics of 3D Rigid Objects
arXiv:1901.00466
Abstract
Humans have a remarkable ability to predict the effect of physical interactions on the dynamics of objects. Endowing machines with this ability would allow important applications in areas like robotics and autonomous vehicles. In this work, we focus on predicting the dynamics of 3D rigid objects, in particular an object's final resting position and total rotation when subjected to an impulsive force. Different from previous work, our approach is capable of generalizing to unseen object shapes - an important requirement for real-world applications. To achieve this, we represent object shape as a 3D point cloud that is used as input to a neural network, making our approach agnostic to appearance variation. The design of our network is informed by an understanding of physical laws. We train our model with data from a physics engine that simulates the dynamics of a large number of shapes. Experiments show that we can accurately predict the resting position and total rotation for unseen object geometries.
13 pages, 12 figures, 1 table
References in corpus (9)
- Interaction Networks for Learning about Objects, Relations and Physics
- A Compositional Object-Based Approach to Learning Physical Dynamics
- Learning Physical Intuition of Block Towers by Example
- Visual Interaction Networks
- To Fall Or Not To Fall: A Visual Approach to Physical Stability Prediction
- Learning A Physical Long-term Predictor
- IntPhys: A Framework and Benchmark for Visual Intuitive Physics Reasoning
- A Comparative Evaluation of Approximate Probabilistic Simulation and Deep Neural Networks as Accounts of Human Physical Scene Understanding
- Learning to Represent Mechanics via Long-term Extrapolation and Interpolation