On the Structure of Time-delay Embedding in Linear Models of Non-linear Dynamical Systems

Abstract

This work addresses fundamental issues related to the structure and conditioning of linear time-delayed models of non-linear dynamics on an attractor. While this approach has been well-studied in the asymptotic sense (e.g. for infinite number of delays), the non-asymptotic setting is not well-understood. First, we show that the minimal time-delays required for perfect signal recovery are solely determined by the sparsity in the Fourier spectrum for scalar systems. For the vector case, we provide a rank test and a geometric interpretation for the necessary and sufficient conditions for the existence of an accurate linear time delayed model. Further, we prove that the output controllability index of a linear system induced by the Fourier spectrum serves as a tight upper bound on the minimal number of time delays required. An explicit expression for the exact linear model in the spectral domain is also provided. From a numerical perspective, the effect of the sampling rate and the number of time delays on numerical conditioning is examined. An upper bound on the condition number is derived, with the implication that conditioning can be improved with additional time delays and/or decreasing sampling rates. Moreover, it is explicitly shown that the underlying dynamics can be accurately recovered using only a partial period of the attractor. Our analysis is first validated in simple periodic and quasi-periodic systems, and sensitivity to noise is also investigated. Finally, issues and practical strategies of choosing time delays in large-scale chaotic systems are discussed and demonstrated on 3D turbulent Rayleigh-Bénard convection.

arXiv comment30 pages

References in corpus (15)

• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• On Dynamic Mode Decomposition: Theory and Applications
• Practical implementation of nonlinear time series methods: The TISEAN package
• Chaos as an Intermittently Forced Linear System
• Ergodic theory, Dynamic Mode Decomposition and Computation of Spectral Properties of the Koopman operator
• Sparse identification of nonlinear dynamics for model predictive control in the low-data limit
• Deep learning of dynamics and signal-noise decomposition with time-stepping constraints
• Discovery of Nonlinear Multiscale Systems: Sampling Strategies and Embeddings
• Physics-Informed Probabilistic Learning of Linear Embeddings of Non-linear Dynamics With Guaranteed Stability
• Study of dynamics in post-transient flows using Koopman mode decomposition
• Long-time predictive modeling of nonlinear dynamical systems using neural networks
• Data-driven Discovery of Closure Models
• Sparsity-promoting algorithms for the discovery of informative Koopman invariant subspaces
• A Priori Estimation Of Memory Effects In Coarse-Grained Nonlinear Systems Using The Mori-Zwanzig Formalism
• Compressive sampling and dynamic mode decomposition

Cited by in corpus (14)

• Residual Dynamic Mode Decomposition: Robust and verified Koopmanism
• Sparsity-promoting algorithms for the discovery of informative Koopman invariant subspaces
• Multiscale Wavelet Transfer Entropy with Application to Corticomuscular Coupling Analysis
• Structured Time-Delay Models for Dynamical Systems with Connections to Frenet-Serret Frame
• Deep learning delay coordinate dynamics for chaotic attractors from partial observable data
• An overview of Koopman-based control: From error bounds to closed-loop guarantees
• Using Zigzag Persistent Homology to Detect Hopf Bifurcations in Dynamical Systems
• Accelerating Particle-in-Cell Kinetic Plasma Simulations via Reduced-Order Modeling of Space-Charge Dynamics using Dynamic Mode Decomposition
• Closed-Loop Koopman Operator Approximation
• A Dynamic Mode Decomposition Approach for Decentralized Spectral Clustering of Graphs
• The spatiotemporal coupling in delay-coordinates dynamic mode decomposition
• Forecasting the evolution of three-dimensional turbulent recirculating flows from sparse sensor data
• On the Predictive Capability of Dynamic Mode Decomposition for Nonlinear Periodic Systems with Focus on Orbital Mechanics
• Data-driven network analysis using local delay embeddings