Numerical Gaussian Processes for Time-dependent and Non-linear Partial Differential Equations

Abstract

We introduce the concept of numerical Gaussian processes, which we define as Gaussian processes with covariance functions resulting from temporal discretization of time-dependent partial differential equations. Numerical Gaussian processes, by construction, are designed to deal with cases where: (1) all we observe are noisy data on black-box initial conditions, and (2) we are interested in quantifying the uncertainty associated with such noisy data in our solutions to time-dependent partial differential equations. Our method circumvents the need for spatial discretization of the differential operators by proper placement of Gaussian process priors. This is an attempt to construct structured and data-efficient learning machines, which are explicitly informed by the underlying physics that possibly generated the observed data. The effectiveness of the proposed approach is demonstrated through several benchmark problems involving linear and nonlinear time-dependent operators. In all examples, we are able to recover accurate approximations of the latent solutions, and consistently propagate uncertainty, even in cases involving very long time integration.

References in corpus (2)

• Machine Learning of Linear Differential Equations using Gaussian Processes
• Posterior Consistency for Gaussian Process Approximations of Bayesian Posterior Distributions

Cited by in corpus (10)

• Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equations
• Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equations
• Machine Learning of Linear Differential Equations using Gaussian Processes
• Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations
• SciANN: A Keras/Tensorflow wrapper for scientific computations and physics-informed deep learning using artificial neural networks
• Deep Learning for Physical Processes: Incorporating Prior Scientific Knowledge
• Multistep Neural Networks for Data-driven Discovery of Nonlinear Dynamical Systems
• Neural-net-induced Gaussian process regression for function approximation and PDE solution
• Solving forward and inverse problems of the logarithmic nonlinear Schrodinger equation with PT-symmetric harmonic potential via deep learning
• Extracting structured dynamical systems using sparse optimization with very few samples