Learning Dynamics from Noisy Measurements using Deep Learning with a Runge-Kutta Constraint

Abstract

Measurement noise is an integral part while collecting data of a physical process. Thus, noise removal is a necessary step to draw conclusions from these data, and it often becomes quite essential to construct dynamical models using these data. We discuss a methodology to learn differential equation(s) using noisy and sparsely sampled measurements. In our methodology, the main innovation can be seen in of integration of deep neural networks with a classical numerical integration method. Precisely, we aim at learning a neural network that implicitly represents the data and an additional neural network that models the vector fields of the dependent variables. We combine these two networks by enforcing the constraint that the data at the next time-steps can be given by following a numerical integration scheme such as the fourth-order Runge-Kutta scheme. The proposed framework to learn a model predicting the vector field is highly effective under noisy measurements. The approach can handle scenarios where dependent variables are not available at the same temporal grid. We demonstrate the effectiveness of the proposed method to learning models using data obtained from various differential equations. The proposed approach provides a promising methodology to learn dynamic models, where the first-principle understanding remains opaque.

References in corpus (13)

• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
• Deep learning for universal linear embeddings of nonlinear dynamics
• Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equations
• Using Machine Learning to Replicate Chaotic Attractors and Calculate Lyapunov Exponents from Data
• Attractor Reconstruction by Machine Learning
• Deep learning of dynamics and signal-noise decomposition with time-stepping constraints
• Multistep Neural Networks for Data-driven Discovery of Nonlinear Dynamical Systems
• DeepMoD: Deep learning for Model Discovery in noisy data
• Long-time predictive modeling of nonlinear dynamical systems using neural networks
• Efficient inference of parsimonious phenomenological models of cellular dynamics using S-systems and alternating regression
• Discovery of Nonlinear Dynamical Systems using a Runge-Kutta Inspired Dictionary-based Sparse Regression Approach

Cited by in corpus (3)

• A Causality-Based Learning Approach for Discovering the Underlying Dynamics of Complex Systems from Partial Observations with Stochastic Parameterization
• Data-Driven Statistical Reduced-Order Modeling and Quantification of Polycrystal Mechanics Leading to Porosity-Based Ductile Damage
• Learning Low-Dimensional Quadratic-Embeddings of High-Fidelity Nonlinear Dynamics using Deep Learning