On the Mathematical Theory of Ensemble (Linear-Gaussian) Kalman-Bucy Filtering
arXiv:2006.08843 · doi:10.1007/s00498-023-00357-2
Abstract
The purpose of this review is to present a comprehensive overview of the theory of ensemble Kalman-Bucy filtering for continuous-time, linear-Gaussian signal and observation models. We present a system of equations that describe the flow of individual particles and the flow of the sample covariance and the sample mean in continuous-time ensemble filtering. We consider these equations and their characteristics in a number of popular ensemble Kalman filtering variants. Given these equations, we study their asymptotic convergence to the optimal Bayesian filter. We also study in detail some non-asymptotic time-uniform fluctuation, stability, and contraction results on the sample covariance and sample mean (or sample error track). We focus on testable signal/observation model conditions, and we accommodate fully unstable (latent) signal models. We discuss the relevance and importance of these results in characterising the filter's behaviour, e.g. it's signal tracking performance, and we contrast these results with those in classical studies of stability in Kalman-Bucy filtering.We also provide a novel (and negative) result proving that the bootstrap particle filter cannot track even the most basic unstable latent signal, in contrast with the ensemble Kalman filter (and the optimal filter). We provide intuition for how the main results extend to nonlinear signal models and comment on their consequence on some typical filter behaviours seen in practice, e.g. catastrophic divergence.
References in corpus (33)
- Central limit theorem for sequential Monte Carlo methods and its application to Bayesian inference
- The Ensemble Kalman Filter for Inverse Problems
- Strong and weak divergence in finite time of Euler's method for stochastic differential equations with non-globally Lipschitz continuous coefficients
- Can local particle filters beat the curse of dimensionality?
- Data Assimilation: A Mathematical Introduction
- On the Convergence of the Ensemble Kalman Filter
- Well-Posedness And Accuracy Of The Ensemble Kalman Filter In Discrete And Continuous Time
- Multilevel ensemble Kalman filtering
- Parameterizations for Ensemble Kalman Inversion
- Nonlinear stability and ergodicity of ensemble based Kalman filters
- Convergence of the Square Root Ensemble Kalman Filter in the Large Ensemble Limit
- Deterministic Mean-field Ensemble Kalman Filtering
- Stability properties of some particle filters
- Uniform Time Average Consistency of Monte Carlo Particle Filters
- Long-time stability and accuracy of the ensemble Kalman-Bucy filter for fully observed processes and small measurement noise
- On the Stability of Kalman-Bucy Diffusion Processes
- Observability and nonlinear filtering
- The stability of conditional Markov processes and Markov chains in random environments
- Long-term stability of sequential Monte Carlo methods under verifiable conditions
- McKean-Vlasov SDEs in nonlinear filtering
- A perturbation analysis of stochastic matrix Riccati diffusions
- On the stability of matrix-valued Riccati diffusions
- On the continuous time limit of the Ensemble Kalman Filter
- An Introduction to Wishart Matrix Moments
- Analysis of a localised nonlinear Ensemble Kalman Bucy Filter with complete and accurate observations
- Perturbations and projections of Kalman-Bucy semigroups
- On One-Dimensional Riccati Diffusions
- Mean field limit of Ensemble Square Root Filters -- discrete and continuous time
- Stability Properties of Systems of Linear Stochastic Differential Equations with Random Coefficients
- An explicit Floquet-type representation of Riccati aperiodic exponential semigroups
- On the continuous time limit of Ensemble Square Root Filters
- Ensemble filter techniques for intermittent data assimilation - a survey
- Multi-index ensemble Kalman filtering