Bayesian learning with Gaussian processes for low-dimensional representations of time-dependent nonlinear systems

Abstract

This work presents a data-driven method for learning low-dimensional time-dependent physics-based surrogate models whose predictions are endowed with uncertainty estimates. We use the operator inference approach to model reduction that poses the problem of learning low-dimensional model terms as a regression of state space data and corresponding time derivatives by minimizing the residual of reduced system equations. Standard operator inference models perform well with accurate training data that are dense in time, but producing stable and accurate models when the state data are noisy and/or sparse in time remains a challenge. Another challenge is the lack of uncertainty estimation for the predictions from the operator inference models. Our approach addresses these challenges by incorporating Gaussian process surrogates into the operator inference framework to (1) probabilistically describe uncertainties in the state predictions and (2) procure analytical time derivative estimates with quantified uncertainties. The formulation leads to a generalized least-squares regression and, ultimately, reduced-order models that are described probabilistically with a closed-form expression for the posterior distribution of the operators. The resulting probabilistic surrogate model propagates uncertainties from the observed state data to reduced-order predictions. We demonstrate the method is effective for constructing low-dimensional models of two nonlinear partial differential equations representing a compressible flow and a nonlinear diffusion-reaction process, as well as for estimating the parameters of a low-dimensional system of nonlinear ordinary differential equations representing compartmental models in epidemiology.

https://github.com/Sandialabs/GP-BayesOpInf

References in corpus (15)

• Scikit-learn: Machine Learning in Python
• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• Machine Learning of Linear Differential Equations using Gaussian Processes
• Lift & Learn: Physics-informed machine learning for large-scale nonlinear dynamical systems
• A Quadratic Manifold for Model Order Reduction of Nonlinear Structural Dynamics
• Data-driven reduced-order models via regularized operator inference for a single-injector combustion process
• Operator inference for non-intrusive model reduction of systems with non-polynomial nonlinear terms
• Operator inference for non-intrusive model reduction with quadratic manifolds
• Learning physics-based reduced-order models for a single-injector combustion process
• Bayesian operator inference for data-driven reduced-order modeling
• Non-intrusive reduced-order models for parametric partial differential equations via data-driven operator inference
• mfEGRA: Multifidelity Efficient Global Reliability Analysis through Active Learning for Failure Boundary Location
• Learning constitutive models from microstructural simulations via a non-intrusive reduced basis method
• Learning Physical Models that Can Respect Conservation Laws
• Gradient Preserving Operator Inference: Data-Driven Reduced-Order Models for Equations with Gradient Structure

Cited by in corpus (1)

• Hyper-reduction-free reduced-order Newton solvers for projection-based model-order reduction of nonlinear dynamical systems