Model selection of chaotic systems from data with hidden variables using sparse data assimilation

Abstract

Many natural systems exhibit chaotic behaviour such as the weather, hydrology, neuroscience and population dynamics. Although many chaotic systems can be described by relatively simple dynamical equations, characterizing these systems can be challenging, due to sensitivity to initial conditions and difficulties in differentiating chaotic behavior from noise. Ideally, one wishes to find a parsimonious set of equations that describe a dynamical system. However, model selection is more challenging when only a subset of the variables are experimentally accessible. Manifold learning methods using time-delay embeddings can successfully reconstruct the underlying structure of the system from data with hidden variables, but not the equations. Recent work in sparse-optimization based model selection has enabled model discovery given a library of possible terms, but regression-based methods require measurements of all state variables. We present a method combining variational annealing -- a technique previously used for parameter estimation in chaotic systems with hidden variables -- with sparse optimization methods to perform model identification for chaotic systems with unmeasured variables. We applied the method to experimental data from an electrical circuit with Lorenz-system like behavior to successfully recover the circuit equations with two measured and one hidden variable. We discuss the robustness of our method to varying noise and manifold sampling using ground-truth time-series simulated from the classic Lorenz system.

References in corpus (30)

• Least Angle Regression
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Discussion of "Least angle regression" by Efron et al
• Rejoinder to "Least angle regression" by Efron et al
• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• Data-driven discovery of coordinates and governing equations
• Next Generation Reservoir Computing
• Predicting catastrophes in nonlinear dynamical systems by compressive sensing
• Weak SINDy For Partial Differential Equations
• Sparse learning of stochastic dynamic equations
• Model selection for dynamical systems via sparse regression and information criteria
• Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: a case study with the Lorenz 96 model
• Least angle and ${\ell }_1$ penalized regression: A review
• Autonomous Discovery of Unknown Reaction Pathways from Data by Chemical Reaction Neural Network
• Bayesian inference of chaotic dynamics by merging data assimilation, machine learning and expectation-maximization
• Model selection for hybrid dynamical systems via sparse regression
• Machine learning algorithms for predicting the amplitude of chaotic laser pulses
• How Entropic Regression Beats the Outliers Problem in Nonlinear System Identification
• Identification of physical processes via combined data-driven and data-assimilation methods
• Estimating model evidence using data assimilation
• Automated, predictive, and interpretable inference of C. elegans escape dynamics
• IDENT: Identifying Differential Equations with Numerical Time evolution
• Statistical data assimilation for estimating electrophysiology simultaneously with connectivity within a biological neuronal network
• Model-free prediction of noisy chaotic time series by deep learning

Cited by in corpus (1)

• Discovering Sparse Interpretable Dynamics from Partial Observations