CEBoosting: Online Sparse Identification of Dynamical Systems with Regime Switching by Causation Entropy Boosting

Abstract

Regime switching is ubiquitous in many complex dynamical systems with multiscale features, chaotic behavior, and extreme events. In this paper, a causation entropy boosting (CEBoosting) strategy is developed to facilitate the detection of regime switching and the discovery of the dynamics associated with the new regime via online model identification. The causation entropy, which can be efficiently calculated, provides a logic value of each candidate function in a pre-determined library. The reversal of one or a few such causation entropy indicators associated with the model calibrated for the current regime implies the detection of regime switching. Despite the short length of each batch formed by the sequential data, the accumulated value of causation entropy corresponding to a sequence of data batches leads to a robust indicator. With the detected rectification of the model structure, the subsequent parameter estimation becomes a quadratic optimization problem, which is solved using closed analytic formulae. Using the Lorenz 96 model, it is shown that the causation entropy indicator can be efficiently calculated, and the method applies to moderately large dimensional systems. The CEBoosting algorithm is also adaptive to the situation with partial observations. It is shown via a stochastic parameterized model that the CEBoosting strategy can be combined with data assimilation to identify regime switching triggered by the unobserved latent processes. In addition, the CEBoosting method is applied to a nonlinear paradigm model for topographic mean flow interaction, demonstrating the online detection of regime switching in the presence of strong intermittency and extreme events.

arXiv comment34 pages, 9 figures

References in corpus (36)

• XGBoost: A Scalable Tree Boosting System
• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• Measuring Information Transfer
• Granger causality and transfer entropy are equivalent for Gaussian variables
• A Physics Informed Machine Learning Approach for Reconstructing Reynolds Stress Modeling Discrepancies Based on DNS Data
• A Comprehensive Physics-Informed Machine Learning Framework for Predictive Turbulence Modeling
• Physics-Informed Machine Learning Approach for Augmenting Turbulence Models: A Comprehensive Framework
• Quantifying and Reducing Model-Form Uncertainties in Reynolds-Averaged Navier-Stokes Simulations: A Data-Driven, Physics-Based Bayesian Approach
• Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise limit, with active learning and control
• Causal Network Inference by Optimal Causation Entropy
• Data-Driven POD-Galerkin Reduced Order Model for Turbulent Flows
• Machine Learning for Stochastic Parameterization: Generative Adversarial Networks in the Lorenz '96 Model
• Causation Entropy Identifies Indirect Influences, Dominance of Neighbors and Anticipatory Couplings
• Recurrence time analysis, long-term correlations, and extreme events
• Sparse Dynamics for Partial Differential Equations
• Online Sparse System Identification and Signal Reconstruction using Projections onto Weighted ${\ell }_1$ Balls
• Data-driven prediction of a multi-scale Lorenz 96 chaotic system using deep learning methods: Reservoir computing, ANN, and RNN-LSTM
• Sparse Identification of Nonlinear Dynamics for Rapid Model Recovery
• On closures for reduced order models $-$ A spectrum of first-principle to machine-learned avenues
• A Perspective on Machine Learning Methods in Turbulence Modelling
• Extreme learning machine for reduced order modeling of turbulent geophysical flows
• Data-driven recovery of hidden physics in reduced order modeling of fluid flows
• Ensemble Kalman method for learning turbulence models from indirect observation data
• Supervised learning from noisy observations: Combining machine-learning techniques with data assimilation
• Causality of energy-containing eddies in wall turbulence
• Data-driven model reduction, Wiener projections, and the Koopman-Mori-Zwanzig formalism
• A mollified Ensemble Kalman filter
• How Entropic Regression Beats the Outliers Problem in Nonlinear System Identification
• Using Data Assimilation to Train a Hybrid Forecast System that Combines Machine-Learning and Knowledge-Based Components
• Discovery of interpretable structural model errors by combining Bayesian sparse regression and data assimilation: A chaotic Kuramoto-Sivashinsky test case
• Conditional Gaussian Nonlinear System: a Fast Preconditioner and a Cheap Surrogate Model For Complex Nonlinear Systems
• A Causality-Based Learning Approach for Discovering the Underlying Dynamics of Complex Systems from Partial Observations with Stochastic Parameterization
• Entropic Causal Inference for Neurological Applications
• Efficient Construction of Local Parametric Reduced Order Models Using Machine Learning Techniques
• Strange Attractors Characterizing the Osmotic Instability
• ERFit: Entropic Regression Fit Matlab Package, for Data-Driven System Identification of Underlying Dynamic Equations

Cited by in corpus (5)

• Neural Dynamical Operator: Continuous Spatial-Temporal Model with Gradient-Based and Derivative-Free Optimization Methods
• CGNSDE: Conditional Gaussian Neural Stochastic Differential Equation for Modeling Complex Systems and Data Assimilation
• CGKN: A Deep Learning Framework for Modeling Complex Dynamical Systems and Efficient Data Assimilation
• Modeling Partially Observed Nonlinear Dynamical Systems and Efficient Data Assimilation via Discrete-Time Conditional Gaussian Koopman Network
• Active Learning of Model Discrepancy with Bayesian Experimental Design