Approximate Smoothing and Parameter Estimation in High-Dimensional State-Space Models
arXiv:1606.08650 · doi:10.1109/TSP.2017.2733504
Abstract
We present approximate algorithms for performing smoothing in a class of high-dimensional state-space models via sequential Monte Carlo methods ("particle filters"). In high dimensions, a prohibitively large number of Monte Carlo samples ("particles") -- growing exponentially in the dimension of the state space -- is usually required to obtain a useful smoother. Using blocking strategies as in Rebeschini and Van Handel (2015) (and earlier pioneering work on blocking), we exploit the spatial ergodicity properties of the model to circumvent this curse of dimensionality. We thus obtain approximate smoothers that can be computed recursively in time and in parallel in space. First, we show that the bias of our blocked smoother is bounded uniformly in the time horizon and in the model dimension. We then approximate the blocked smoother with particles and derive the asymptotic variance of idealised versions of our blocked particle smoother to show that variance is no longer adversely effected by the dimension of the model. Finally, we employ our method to successfully perform maximum-likelihood estimation via stochastic gradient-ascent and stochastic expectation--maximisation algorithms in a 100-dimensional state-space model.
arXiv commentIncludes supplementary materials
References in corpus (14)
- Tractable Inference for Complex Stochastic Processes
- Curse-of-dimensionality revisited: Collapse of the particle filter in very large scale systems
- On Particle Methods for Parameter Estimation in State-Space Models
- Can local particle filters beat the curse of dimensionality?
- On the utility of graphics cards to perform massively parallel simulation of advanced Monte Carlo methods
- On adaptive resampling strategies for sequential Monte Carlo methods
- Sequential Monte Carlo smoothing for general state space hidden Markov models
- Factored Particles for Scalable Monitoring
- Stability properties of some particle filters
- Long-term stability of sequential Monte Carlo methods under verifiable conditions
- A Stable Particle Filter in High-Dimensions
- Nested Sequential Monte Carlo Methods
- On the Forward Filtering Backward Smoothing particle approximations of the smoothing distribution in general state spaces models
- Comparison Theorems for Gibbs Measures