Physics-enhanced Neural Networks in the Small Data Regime

Abstract

Identifying the dynamics of physical systems requires a machine learning model that can assimilate observational data, but also incorporate the laws of physics. Neural Networks based on physical principles such as the Hamiltonian or Lagrangian NNs have recently shown promising results in generating extrapolative predictions and accurately representing the system's dynamics. We show that by additionally considering the actual energy level as a regularization term during training and thus using physical information as inductive bias, the results can be further improved. Especially in the case where only small amounts of data are available, these improvements can significantly enhance the predictive capability. We apply the proposed regularization term to a Hamiltonian Neural Network (HNN) and Constrained Hamiltonian Neural Network (CHHN) for a single and double pendulum, generate predictions under unseen initial conditions and report significant gains in predictive accuracy.

References in corpus (7)

• Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Data
• Understanding and mitigating gradient pathologies in physics-informed neural networks
• When and why PINNs fail to train: A neural tangent kernel perspective
• Deep Lagrangian Networks: Using Physics as Model Prior for Deep Learning
• Hamiltonian Graph Networks with ODE Integrators
• Lagrangian Neural Networks
• Incorporating physical constraints in a deep probabilistic machine learning framework for coarse-graining dynamical systems

Cited by in corpus (1)

• Can physical information aid the generalization ability of Neural Networks for hydraulic modeling?