Model selection for dynamical systems via sparse regression and information criteria

Abstract

We develop an algorithm for model selection which allows for the consideration of a combinatorially large number of candidate models governing a dynamical system. The innovation circumvents a disadvantage of standard model selection which typically limits the number candidate models considered due to the intractability of computing information criteria. Using a recently developed sparse identification of nonlinear dynamics algorithm, the sub-selection of candidate models near the Pareto frontier allows for a tractable computation of AIC (Akaike information criteria) or BIC (Bayes information criteria) scores for the remaining candidate models. The information criteria hierarchically ranks the most informative models, enabling the automatic and principled selection of the model with the strongest support in relation to the time series data. Specifically, we show that AIC scores place each candidate model in the {\em strong support}, {\em weak support} or {\em no support} category. The method correctly identifies several canonical dynamical systems, including an SEIR (susceptible-exposed-infectious-recovered) disease model and the Lorenz equations, giving the correct dynamical system as the only candidate model with strong support.

14 pages, 6 figures, 1 algorithm

References in corpus (1)

• Data Based Identification and Prediction of Nonlinear and Complex Dynamical Systems

Cited by in corpus (42)

• Data-driven discovery of coordinates and governing equations
• Data-Driven Sparse Sensor Placement for Reconstruction
• Sparse identification of nonlinear dynamics for model predictive control in the low-data limit
• SINDy-PI: A Robust Algorithm for Parallel Implicit Sparse Identification of Nonlinear Dynamics
• Discovery of Algebraic Reynolds-Stress Models Using Sparse Symbolic Regression
• Sparse reduced-order modeling : Sensor-based dynamics to full-state estimation
• Discovery of Nonlinear Multiscale Systems: Sampling Strategies and Embeddings
• Sparse Identification of Nonlinear Dynamics for Rapid Model Recovery
• A Bayesian machine scientist to aid in the solution of challenging scientific problems
• Robust learning from noisy, incomplete, high-dimensional experimental data via physically constrained symbolic regression
• A computational framework for physics-informed symbolic regression with straightforward integration of domain knowledge
• Sparse Identification of Nonlinear Dynamical Systems via Reweighted ${\ell }_1$-regularized Least Squares
• Discovery of Physics from Data: Universal Laws and Discrepancies
• Learning hydrodynamic equations for active matter from particle simulations and experiments
• Feature engineering and symbolic regression methods for detecting hidden physics from sparse sensors
• Model selection for hybrid dynamical systems via sparse regression
• Learning differential equation models from stochastic agent-based model simulations
• On spike-and-slab priors for Bayesian equation discovery of nonlinear dynamical systems via sparse linear regression
• Learning partial differential equations for biological transport models from noisy spatiotemporal data
• Variational system identification of the partial differential equations governing microstructure evolution in materials: Inference over sparse and spatially unrelated data
• Identification of physical processes via combined data-driven and data-assimilation methods
• Probabilistic Grammars for Equation Discovery
• Sparse Identification of Truncation Errors
• Sparse dynamical system identification with simultaneous structural parameters and initial condition estimation
• Noise-aware Physics-informed Machine Learning for Robust PDE Discovery
• A Levenberg-Marquardt algorithm for sparse identification of dynamical systems
• Model selection of chaotic systems from data with hidden variables using sparse data assimilation
• Learning Closed-form Equations for Subgrid-scale Closures from High-fidelity Data: Promises and Challenges
• Discovery of interpretable structural model errors by combining Bayesian sparse regression and data assimilation: A chaotic Kuramoto-Sivashinsky test case
• Dynamical System Identification, Model Selection and Model Uncertainty Quantification by Bayesian Inference
• Symbolic Regression via Neural Networks
• Adaptive Uncertainty-Guided Model Selection for Data-Driven PDE Discovery
• Identification of Physical Processes and Unknown Parameters of 3D Groundwater Contaminant Problems via Theory-guided U-net
• SPADE4: Sparsity and Delay Embedding based Forecasting of Epidemics
• Challenges in identifying simple pattern-forming mechanisms in the development of settlements using demographic data
• BINDy -- Bayesian identification of nonlinear dynamics with reversible-jump Markov-chain Monte-Carlo
• Learning Continuous Network Emerging Dynamics from Scarce Observations via Data-Adaptive Stochastic Processes
• Grammar-based Ordinary Differential Equation Discovery
• Critical Sampling for Robust Evolution Operator Learning of Unknown Dynamical Systems
• Mono- and Polyauxic Growth Kinetics: A Semi-Mechanistic Framework for Complex Biological Dynamics
• Hyperparameter Optimization in the Estimation of PDE and Delay-PDE models from data
• Cosmological Dynamics of Exponential Quintessence Constrained by BAO, Cosmic Chronometers, and DES-SN5YR/Pantheon+ Data