Symbolic Pregression: Discovering Physical Laws from Distorted Video

Abstract

We present a method for unsupervised learning of equations of motion for objects in raw and optionally distorted unlabeled video. We first train an autoencoder that maps each video frame into a low-dimensional latent space where the laws of motion are as simple as possible, by minimizing a combination of non-linearity, acceleration and prediction error. Differential equations describing the motion are then discovered using Pareto-optimal symbolic regression. We find that our pre-regression ("pregression") step is able to rediscover Cartesian coordinates of unlabeled moving objects even when the video is distorted by a generalized lens. Using intuition from multidimensional knot-theory, we find that the pregression step is facilitated by first adding extra latent space dimensions to avoid topological problems during training and then removing these extra dimensions via principal component analysis.

Expanded and improved physics discussion, additional method details. 9 pages, 7 figs

References in corpus (6)

• Learning phase transitions by confusion
• Decomposing Motion and Content for Natural Video Sequence Prediction
• AI Feynman 2.0: Pareto-optimal symbolic regression exploiting graph modularity
• Deep Learning the Quantum Phase Transitions in Random Electron Systems: Applications to Three Dimensions
• Video Ladder Networks
• Comment on the article "Distilling free-form natural laws from experimental data"

Cited by in corpus (12)

• AI Feynman 2.0: Pareto-optimal symbolic regression exploiting graph modularity
• Machine-Learning Non-Conservative Dynamics for New-Physics Detection
• Learning phase transitions from regression uncertainty: A new regression-based machine learning approach for automated detection of phases of matter
• Learning Potentials of Quantum Systems using Deep Neural Networks
• Noether Networks: Meta-Learning Useful Conserved Quantities
• Uncovering Closed-form Governing Equations of Nonlinear Dynamics from Videos
• Reveal flocking phase transition of self-propelled active particles by machine learning regression uncertainty
• SyMetric: Measuring the Quality of Learnt Hamiltonian Dynamics Inferred from Vision
• Similarity-Based Equational Inference in Physics
• Physics-Informed Deep Learning Characterizes Morphodynamics of Asian Soybean Rust Disease
• Physical discovery in representation learning via conditioning on prior knowledge: applications for ferroelectric domain dynamics
• Deep learning of thermodynamic laws from microscopic dynamics