Parsimony-Enhanced Sparse Bayesian Learning for Robust Discovery of Partial Differential Equations

Abstract

Robust physics discovery is of great interest for many scientific and engineering fields. Inspired by the principle that a representative model is the one simplest possible, a new model selection criteria considering both model's Parsimony and Sparsity is proposed. A Parsimony Enhanced Sparse Bayesian Learning (PeSBL) method is developed for discovering the governing Partial Differential Equations (PDEs) of nonlinear dynamical systems. Compared with the conventional Sparse Bayesian Learning (SBL) method, the PeSBL method promotes parsimony of the learned model in addition to its sparsity. In this method, the parsimony of model terms is evaluated using their locations in the prescribed candidate library, for the first time, considering the increased complexity with the power of polynomials and the order of spatial derivatives. Subsequently, the model parameters are updated through Bayesian inference with the raw data. This procedure aims to reduce the error associated with the possible loss of information in data preprocessing and numerical differentiation prior to sparse regression. Results of numerical case studies indicate that the governing PDEs of many canonical dynamical systems can be correctly identified using the proposed PeSBL method from highly noisy data (up to 50% in the current study). Next, the proposed methodology is extended for stochastic PDE learning where all parameters and modeling error are considered as random variables. Hierarchical Bayesian Inference (HBI) is integrated with the proposed framework for stochastic PDE learning from a population of observations. Finally, the proposed PeSBL is demonstrated for system response prediction with uncertainties and anomaly diagnosis. Codes of all demonstrated examples in this study are available on the website: https://github.com/ymlasu.

arXiv admin note: text overlap with arXiv:2102.06504

References in corpus (13)

• Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equations
• Physics-informed learning of governing equations from scarce data
• Robust learning from noisy, incomplete, high-dimensional experimental data via physically constrained symbolic regression
• DLGA-PDE: Discovery of PDEs with incomplete candidate library via combination of deep learning and genetic algorithm
• On spike-and-slab priors for Bayesian equation discovery of nonlinear dynamical systems via sparse linear regression
• Data-driven discovery of free-form governing differential equations
• Data-driven Identification of 2D Partial Differential Equations using extracted physical features
• Data-driven PDE discovery with evolutionary approach
• Data-driven Discovery of Partial Differential Equations for Multiple-Physics Electromagnetic Problem
• Machine Discovery of Partial Differential Equations from Spatiotemporal Data
• Bayesian data-driven discovery of partial differential equations with variable coefficients
• Machine Learning of Partial Differential Equations from Noise Data
• Robust Data-Driven Discovery of Partial Differential Equations under Uncertainties

Cited by in corpus (2)

• Robust physics discovery via supervised and unsupervised pattern recognition using the Euler characteristic
• Physics-informed AI and ML-based sparse system identification algorithm for discovery of PDE's representing nonlinear dynamic systems