Combining Dynamic Mode Decomposition with Ensemble Kalman Filtering for Tracking and Forecasting
arXiv:2301.05504 · doi:10.1016/j.physd.2023.133741
Abstract
Data assimilation techniques, such as ensemble Kalman filtering, have been shown to be a highly effective and efficient way to combine noisy data with a mathematical model to track and forecast dynamical systems. However, when dealing with high-dimensional data, in many situations one does not have a model, so data assimilation techniques cannot be applied. In this paper, we use dynamic mode decomposition to generate a low-dimensional, linear model of a dynamical system directly from high-dimensional data, which is defined by temporal and spatial modes, that we can then use with data assimilation techniques such as the ensemble Kalman filter. We show how the dynamic mode decomposition can be combined with the ensemble Kalman filter (which we call the DMDEnKF) to iteratively update the current state and temporal modes as new data becomes available. We demonstrate that this approach is able to track time varying dynamical systems in synthetic examples, and experiment with the use of time-delay embeddings. We then apply the DMDEnKF to real world seasonal influenza-like illness data from the USA Centers for Disease Control and Prevention, and find that for short term forecasting, the DMDEnKF is comparable to the best mechanistic models in the ILINet competition.
References in corpus (19)
- A Data-Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition
- On Dynamic Mode Decomposition: Theory and Applications
- Multiscale mobility networks and the large scale spreading of infectious diseases
- Deep learning for universal linear embeddings of nonlinear dynamics
- Sparsity-promoting dynamic mode decomposition
- Extracting spatial-temporal coherent patterns in large-scale neural recordings using dynamic mode decomposition
- Ergodic theory, Dynamic Mode Decomposition and Computation of Spectral Properties of the Koopman operator
- The Moore-Penrose Pseudoinverse. A Tutorial Review of the Theory
- De-Biasing the Dynamic Mode Decomposition for Applied Koopman Spectral Analysis
- Characterizing and correcting for the effect of sensor noise in the dynamic mode decomposition
- Dynamic Mode Decomposition for Large and Streaming Datasets
- Data Assimilation: A Mathematical Introduction
- Flexible Modeling of Epidemics with an Empirical Bayes Framework
- Dynamic mode decomposition using a Kalman filter for parameter estimation
- Extended-Kalman-filter-based dynamic mode decomposition for simultaneous system identification and denoising
- A Brief Tutorial on the Ensemble Kalman Filter
- The Optimal Hard Threshold for Singular Values is 4/sqrt(3)
- Online dynamic mode decomposition for time-varying systems
- Two methods to approximate the Koopman operator with a reservoir computer