SubTSBR to tackle high noise and outliers for data-driven discovery of differential equations

Abstract

Data-driven discovery of differential equations has been an emerging research topic. We propose a novel algorithm subsampling-based threshold sparse Bayesian regression (SubTSBR) to tackle high noise and outliers. The subsampling technique is used for improving the accuracy of the Bayesian learning algorithm. It has two parameters: subsampling size and the number of subsamples. When the subsampling size increases with fixed total sample size, the accuracy of our algorithm goes up and then down. When the number of subsamples increases, the accuracy of our algorithm keeps going up. We demonstrate how to use our algorithm step by step and compare our algorithm with threshold sparse Bayesian regression (TSBR) for the discovery of differential equations. We show that our algorithm produces better results. We also discuss the merits of discovering differential equations from data and demonstrate how to discover models with random initial and boundary condition as well as models with bifurcations. The numerical examples are: (1) predator-prey model with noise, (2) shallow water equations with outliers, (3) heat diffusion with random initial and boundary condition, and (4) fish-harvesting problem with bifurcations.

References in corpus (8)

• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equations
• Machine Learning of Linear Differential Equations using Gaussian Processes
• Physics Informed Deep Learning (Part II): Data-driven Discovery of Nonlinear Partial Differential Equations
• Deep learning of dynamics and signal-noise decomposition with time-stepping constraints
• How Entropic Regression Beats the Outliers Problem in Nonlinear System Identification
• IDENT: Identifying Differential Equations with Numerical Time evolution
• A Unified Framework for Sparse Relaxed Regularized Regression: SR3

Cited by in corpus (5)

• Weak SINDy For Partial Differential Equations
• Weak SINDy: Galerkin-Based Data-Driven Model Selection
• On spike-and-slab priors for Bayesian equation discovery of nonlinear dynamical systems via sparse linear regression
• Sparse Methods for Automatic Relevance Determination
• Parsimony-Enhanced Sparse Bayesian Learning for Robust Discovery of Partial Differential Equations