Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise limit, with active learning and control

Abstract

Sparse model identification enables the discovery of nonlinear dynamical systems purely from data; however, this approach is sensitive to noise, especially in the low-data limit. In this work, we leverage the statistical approach of bootstrap aggregating (bagging) to robustify the sparse identification of nonlinear dynamics (SINDy) algorithm. First, an ensemble of SINDy models is identified from subsets of limited and noisy data. The aggregate model statistics are then used to produce inclusion probabilities of the candidate functions, which enables uncertainty quantification and probabilistic forecasts. We apply this ensemble-SINDy (E-SINDy) algorithm to several synthetic and real-world data sets and demonstrate substantial improvements to the accuracy and robustness of model discovery from extremely noisy and limited data. For example, E-SINDy uncovers partial differential equations models from data with more than twice as much measurement noise as has been previously reported. Similarly, E-SINDy learns the Lotka Volterra dynamics from remarkably limited data of yearly lynx and hare pelts collected from 1900-1920. E-SINDy is computationally efficient, with similar scaling as standard SINDy. Finally, we show that ensemble statistics from E-SINDy can be exploited for active learning and improved model predictive control.

References in corpus (41)

• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators
• Spectral proper orthogonal decomposition and its relationship to dynamic mode decomposition and resolvent analysis
• Fourier Neural Operator for Parametric Partial Differential Equations
• Data-driven discovery of coordinates and governing equations
• Machine Learning of Linear Differential Equations using Gaussian Processes
• Sparse identification of nonlinear dynamics for model predictive control in the low-data limit
• SINDy-PI: A Robust Algorithm for Parallel Implicit Sparse Identification of Nonlinear Dynamics
• Discovery of Algebraic Reynolds-Stress Models Using Sparse Symbolic Regression
• Weak SINDy For Partial Differential Equations
• Sparse learning of stochastic dynamic equations
• Sparse reduced-order modeling : Sensor-based dynamics to full-state estimation
• PySINDy: A comprehensive Python package for robust sparse system identification
• Weak SINDy: Galerkin-Based Data-Driven Model Selection
• Using Noisy or Incomplete Data to Discover Models of Spatiotemporal Dynamics
• Robust learning from noisy, incomplete, high-dimensional experimental data via physically constrained symbolic regression
• Sparse Identification for Nonlinear Optical Communication Systems: SINO Method
• Efficient inference of parsimonious phenomenological models of cellular dynamics using S-systems and alternating regression
• Physics-constrained, low-dimensional models for MHD: First-principles and data-driven approaches
• Formulating turbulence closures using sparse regression with embedded form invariance
• Supervised learning from noisy observations: Combining machine-learning techniques with data assimilation
• Nonlinear stochastic modeling with Langevin regression
• Model-Based Active Exploration
• Bagging, optimized dynamic mode decomposition (BOP-DMD) for robust, stable forecasting with spatial and temporal uncertainty-quantification
• Data-driven discovery of reduced plasma physics models from fully-kinetic simulations
• Multidimensional approximation of nonlinear dynamical systems
• Robust and optimal sparse regression for nonlinear PDE models
• Combining machine learning and data assimilation to forecast dynamical systems from noisy partial observations
• Sparse nonlinear models of chaotic electroconvection
• Data-driven modeling of the chaotic thermal convection in an annular thermosyphon
• PySINDy: A Python package for the Sparse Identification of Nonlinear Dynamics from Data
• Bayesian System ID: Optimal management of parameter, model, and measurement uncertainty
• Sparse Identification of Truncation Errors
• Active Learning for Nonlinear System Identification with Guarantees
• Galerkin force model for transient and post-transient dynamics of the fluidic pinbal
• Learning fluid physics from highly turbulent data using sparse physics-informed discovery of empirical relations (SPIDER)
• Stability selection enables robust learning of partial differential equations from limited noisy data
• Learning normal form autoencoders for data-driven discovery of universal,parameter-dependent governing equations
• Bayesian differential programming for robust systems identification under uncertainty
• CINDy: Conditional gradient-based Identification of Non-linear Dynamics -- Noise-robust recovery
• Sparse identification of multiphase turbulence closures for coupled fluid--particle flows

Cited by in corpus (32)

• PySINDy: A comprehensive Python package for robust sparse system identification
• KAN-ODEs: Kolmogorov-Arnold Network Ordinary Differential Equations for Learning Dynamical Systems and Hidden Physics
• Any equation is a forest: Symbolic genetic algorithm for discovering open-form partial differential equations (SGA-PDE)
• Discovery of Nonlinear Dynamical Systems using a Runge-Kutta Inspired Dictionary-based Sparse Regression Approach
• DySMHO: Data-Driven Discovery of Governing Equations for Dynamical Systems via Moving Horizon Optimization
• Derivative-based SINDy (DSINDy): Addressing the challenge of discovering governing equations from noisy data
• EKF-SINDy: Empowering the extended Kalman filter with sparse identification of nonlinear dynamics
• Direct Estimation of Parameters in ODE Models Using WENDy: Weak-form Estimation of Nonlinear Dynamics
• Hypergraph reconstruction from dynamics
• Noise-aware Physics-informed Machine Learning for Robust PDE Discovery
• Learning Anisotropic Interaction Rules from Individual Trajectories in a Heterogeneous Cellular Population
• Dynamical System Identification, Model Selection and Model Uncertainty Quantification by Bayesian Inference
• Deep Kernel Learning of Dynamical Models from High-Dimensional Noisy Data
• Rheo-SINDy: Finding a Constitutive Model from Rheological Data for Complex Fluids Using Sparse Identification for Nonlinear Dynamics
• CEBoosting: Online Sparse Identification of Dynamical Systems with Regime Switching by Causation Entropy Boosting
• TorchSISSO: A PyTorch-Based Implementation of the Sure Independence Screening and Sparsifying Operator for Efficient and Interpretable Model Discovery
• SINDy-RL: Interpretable and Efficient Model-Based Reinforcement Learning
• Influence of initial conditions on data-driven model identification and information entropy for ideal mhd problems
• Evolutionary Optimization of Physics-Informed Neural Networks: Evo-PINN Frontiers and Opportunities
• Identification of Forced Oscillation Sources in Wind Farms using E-SINDy
• System identification based on characteristic curves: a mathematical connection between power series and Fourier analysis for first-order nonlinear systems
• Data-driven sparse modeling of oscillations in plasma space propulsion
• Learning dynamics on invariant measures using PDE-constrained optimization
• Statistical Mechanics of Dynamical System Identification
• Enhancing model identification with SINDy via nullcline reconstruction
• Challenges in identifying simple pattern-forming mechanisms in the development of settlements using demographic data
• BINDy -- Bayesian identification of nonlinear dynamics with reversible-jump Markov-chain Monte-Carlo
• Unsupervised Constitutive Model Discovery from Sparse and Noisy Data
• Remote Manipulation of Multiple Objects with Airflow Field Using Model-Based Learning Control
• OKRidge: Scalable Optimal k-Sparse Ridge Regression
• Sparse Identification for bifurcating phenomena in Computational Fluid Dynamics
• Hyperparameter Optimization in the Estimation of PDE and Delay-PDE models from data