Discovery of Nonlinear Multiscale Systems: Sampling Strategies and Embeddings

Abstract

A major challenge in the study of dynamical systems is that of model discovery: turning data into models that are not just predictive, but provide insight into the nature of the underlying dynamical system that generated the data. This problem is made more difficult by the fact that many systems of interest exhibit diverse behaviors across multiple time scales. We introduce a number of data-driven strategies for discovering nonlinear multiscale dynamical systems and their embeddings from data. We consider two canonical cases: (i) systems for which we have full measurements of the governing variables, and (ii) systems for which we have incomplete measurements. For systems with full state measurements, we show that the recent sparse identification of nonlinear dynamical systems (SINDy) method can discover governing equations with relatively little data and introduce a sampling method that allows SINDy to scale efficiently to problems with multiple time scales. Specifically, we can discover distinct governing equations at slow and fast scales. For systems with incomplete observations, we show that the Hankel alternative view of Koopman (HAVOK) method, based on time-delay embedding coordinates, can be used to obtain a linear model and Koopman invariant measurement system that nearly perfectly captures the dynamics of nonlinear quasiperiodic systems. We introduce two strategies for using HAVOK on systems with multiple time scales. Together, our approaches provide a suite of mathematical strategies for reducing the data required to discover and model nonlinear multiscale systems.

arXiv comment21 pages, 6 figures

References in corpus (17)

• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• A Data-Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition
• On Dynamic Mode Decomposition: Theory and Applications
• Deep learning for universal linear embeddings of nonlinear dynamics
• Applied Koopmanism
• Koopman invariant subspaces and finite linear representations of nonlinear dynamical systems for control
• Chaos as an Intermittently Forced Linear System
• Extracting spatial-temporal coherent patterns in large-scale neural recordings using dynamic mode decomposition
• Ergodic theory, Dynamic Mode Decomposition and Computation of Spectral Properties of the Koopman operator
• Extended dynamic mode decomposition with dictionary learning: a data-driven adaptive spectral decomposition of the Koopman operator
• Time-lagged autoencoders: Deep learning of slow collective variables for molecular kinetics
• Model selection for dynamical systems via sparse regression and information criteria
• Multistep Neural Networks for Data-driven Discovery of Nonlinear Dynamical Systems
• Learning Koopman Invariant Subspaces for Dynamic Mode Decomposition
• Dynamic Mode Decomposition for Real-Time Background/Foreground Separation in Video
• Learning Deep Neural Network Representations for Koopman Operators of Nonlinear Dynamical Systems
• Koopman Theory for Partial Differential Equations

Cited by in corpus (39)

• Data-driven discovery of coordinates and governing equations
• Integrating Machine Learning and Multiscale Modeling: Perspectives, Challenges, and Opportunities in the Biological, Biomedical, and Behavioral Sciences
• Physics-informed learning of governing equations from scarce data
• Sparse identification of nonlinear dynamics with low-dimensionalized flow representations
• Uniformly Accurate Machine Learning Based Hydrodynamic Models for Kinetic Equations
• Autonomous inference of complex network dynamics from incomplete and noisy data
• Variational system identification of the partial differential equations governing pattern-forming physics: Inference under varying fidelity and noise
• Learning hydrodynamic equations for active matter from particle simulations and experiments
• Bagging, optimized dynamic mode decomposition (BOP-DMD) for robust, stable forecasting with spatial and temporal uncertainty-quantification
• On the Structure of Time-delay Embedding in Linear Models of Non-linear Dynamical Systems
• Reservoir Computing with Diverse Timescales for Prediction of Multiscale Dynamics
• Dynamic mode decomposition for multiscale nonlinear physics
• EKF-SINDy: Empowering the extended Kalman filter with sparse identification of nonlinear dynamics
• Structured Time-Delay Models for Dynamical Systems with Connections to Frenet-Serret Frame
• Interpretable Polynomial Neural Ordinary Differential Equations
• Poincaré Maps for Multiscale Physics Discovery and Nonlinear Floquet Theory
• SINDy for delay-differential equations: application to model bacterial zinc response
• A Perspective on Regression and Bayesian Approaches for System Identification of Pattern Formation Dynamics
• Learning physically consistent mathematical models from data using group sparsity
• WeakIdent: Weak formulation for Identifying Differential Equations using Narrow-fit and Trimming
• Sparse Identification of Slow Timescale Dynamics
• Physics-informed machine learning for sensor fault detection with flight test data
• Data-Driven Stabilization of Periodic Orbits
• Deep Learning of Conjugate Mappings
• Ogden Material Calibration via Magnetic Resonance Cartography, Parameter Sensitivity, and Variational System Identification
• HAVOK Model Predictive Control for Time-Delay Systems with Applications to District Heating
• Koopman Operator Dynamical Models: Learning, Analysis and Control
• High-Fidelity Digital Twin Data Models by Randomized Dynamic Mode Decomposition and Deep Learning with Applications in Fluid Dynamics
• SPADE4: Sparsity and Delay Embedding based Forecasting of Epidemics
• Discovering time-varying aeroelastic models of a long-span suspension bridge from field measurements by sparse identification of nonlinear dynamical systems
• Hierarchical deep learning-based adaptive time-stepping scheme for multiscale simulations
• Discovery of slow variables in a class of multiscale stochastic systems via neural networks
• Enhancing model identification with SINDy via nullcline reconstruction
• Uncovering Closed-form Governing Equations of Nonlinear Dynamics from Videos
• Physics-aware, probabilistic model order reduction with guaranteed stability
• On the Predictive Capability of Dynamic Mode Decomposition for Nonlinear Periodic Systems with Focus on Orbital Mechanics
• Universal set of Observables for Forecasting Physical Systems through Causal Embedding
• Multiscale and Nonlocal Learning for PDEs using Densely Connected RNNs
• Model discovery in the sparse sampling regime