Adaptive Uncertainty-Guided Model Selection for Data-Driven PDE Discovery
arXiv:2308.10283 · doi:10.1109/ACCESS.2024.3354819
Abstract
We propose a new parameter-adaptive uncertainty-penalized Bayesian information criterion (UBIC) to prioritize the parsimonious partial differential equation (PDE) that sufficiently governs noisy spatial-temporal observed data with few reliable terms. Since the naive use of the BIC for model selection has been known to yield an undesirable overfitted PDE, the UBIC penalizes the found PDE not only by its complexity but also the quantified uncertainty, derived from the model supports' coefficient of variation in a probabilistic view. We also introduce physics-informed neural network learning as a simulation-based approach to further validate the selected PDE flexibly against the other discovered PDE. Numerical results affirm the successful application of the UBIC in identifying the true governing PDE. Additionally, we reveal an interesting effect of denoising the observed data on improving the trade-off between the BIC score and model complexity. Code is available at https://github.com/Pongpisit-Thanasutives/UBIC.
arXiv comment17 pages, 15 figures
References in corpus (24)
- Scikit-learn: Machine Learning in Python
- scikit-image: Image processing in Python
- Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
- DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators
- Asymptotic Equivalence of Bayes Cross Validation and Widely Applicable Information Criterion in Singular Learning Theory
- Spike and slab variable selection: Frequentist and Bayesian strategies
- Machine Learning of Linear Differential Equations using Gaussian Processes
- Dedalus: A Flexible Framework for Numerical Simulations with Spectral Methods
- Sparsity information and regularization in the horseshoe and other shrinkage priors
- Weak SINDy For Partial Differential Equations
- Model selection for dynamical systems via sparse regression and information criteria
- PySINDy: A comprehensive Python package for robust sparse system identification
- Interpretable Machine Learning for Science with PySR and SymbolicRegression.jl
- Using Noisy or Incomplete Data to Discover Models of Spatiotemporal Dynamics
- DLGA-PDE: Discovery of PDEs with incomplete candidate library via combination of deep learning and genetic algorithm
- Any equation is a forest: Symbolic genetic algorithm for discovering open-form partial differential equations (SGA-PDE)
- Neural-net-induced Gaussian process regression for function approximation and PDE solution
- Coarse-scale PDEs from fine-scale observations via machine learning
- Learning partial differential equations for biological transport models from noisy spatiotemporal data
- Constructing coarse-scale bifurcation diagrams from spatio-temporal observations of microscopic simulations: A parsimonious machine learning approach
- Recipes for when Physics Fails: Recovering Robust Learning of Physics Informed Neural Networks
- Noise-aware Physics-informed Machine Learning for Robust PDE Discovery
- Adversarial Multi-task Learning Enhanced Physics-informed Neural Networks for Solving Partial Differential Equations
- Discovery of partial differential equations from highly noisy and sparse data with physics-informed information criterion