Ensemble Kalman methods for high-dimensional hierarchical dynamic space-time models

Abstract

We propose a new class of filtering and smoothing methods for inference in high-dimensional, nonlinear, non-Gaussian, spatio-temporal state-space models. The main idea is to combine the ensemble Kalman filter and smoother, developed in the geophysics literature, with state-space algorithms from the statistics literature. Our algorithms address a variety of estimation scenarios, including on-line and off-line state and parameter estimation. We take a Bayesian perspective, for which the goal is to generate samples from the joint posterior distribution of states and parameters. The key benefit of our approach is the use of ensemble Kalman methods for dimension reduction, which allows inference for high-dimensional state vectors. We compare our methods to existing ones, including ensemble Kalman filters, particle filters, and particle MCMC. Using a real data example of cloud motion and data simulated under a number of nonlinear and non-Gaussian scenarios, we show that our approaches outperform these existing methods.

References in corpus (4)

• The pseudo-marginal approach for efficient Monte Carlo computations
• Gibbs posterior for variable selection in high-dimensional classification and data mining
• A Hierarchical Bayes Ensemble Kalman Filter
• Comment on Article by Dawid and Musio

Cited by in corpus (6)

• Deep Integro-Difference Equation Models for Spatio-Temporal Forecasting
• BAMCAFE: A Bayesian Machine Learning Advanced Forecast Ensemble Method for Complex Turbulent Systems with Partial Observations
• Bagged filters for partially observed interacting systems
• Bellman filtering and smoothing for state-space models
• Analyzing the Effects of Observation Function Selection in Ensemble Kalman Filtering for Epidemic Models
• Warped Dynamic Linear Models for Time Series of Counts