Degenerate Kalman filter error covariances and their convergence onto the unstable subspace

Abstract

The characteristics of the model dynamics are critical in the performance of (ensemble) Kalman filters. In particular, as emphasized in the seminal work of Anna Trevisan and co-authors, the error covariance matrix is asymptotically supported by the unstable-neutral subspace only, i.e., it is spanned by the backward Lyapunov vectors with non-negative exponents. This behavior is at the core of algorithms known as Assimilation in the Unstable Subspace, although a formal proof was still missing. This paper provides the analytical proof of the convergence of the Kalman filter covariance matrix onto the unstable-neutral subspace when the dynamics and the observation operator are linear and when the dynamical model is error-free, for any, possibly rank-deficient, initial error covariance matrix. The rate of convergence is provided as well. The derivation is based on an expression that explicitly relates the error covariances at an arbitrary time to the initial ones. It is also shown that if the unstable and neutral directions of the model are sufficiently observed and if the column space of the initial covariance matrix has a non-zero projection onto all of the forward Lyapunov vectors associated with the unstable and neutral directions of the dynamics, the covariance matrix of the Kalman filter collapses onto an asymptotic sequence which is independent of the initial covariances. Numerical results are also shown to illustrate and support the theoretical findings.

References in corpus (1)

• Data assimilation as a nonlinear dynamical systems problem: Stability and convergence of the prediction-assimilation system

Cited by in corpus (11)

• Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: a case study with the Lorenz 96 model
• Adaptive covariance inflation in the ensemble Kalman filter by Gaussian scale mixtures
• Integrating Recurrent Neural Networks with Data Assimilation for Scalable Data-Driven State Estimation
• Online learning of both state and dynamics using ensemble Kalman filters
• Supervised machine learning to estimate instabilities in chaotic systems: estimation of local Lyapunov exponents
• Identifying efficient ensemble perturbations for initializing subseasonal-to-seasonal prediction
• Uniform Detectability of Linear Time Varying Systems with Exponential Dichotomy
• Inferring the instability of a dynamical system from the skill of data assimilation exercises
• Asymptotic behavior of the forecast-assimilation process with unstable dynamics
• Detectability Conditions and State Estimation for Linear Time-Varying and Nonlinear Systems
• Stability of Non-linear Filter for Deterministic Dynamics