Sequential Monte Carlo smoothing with application to parameter estimation in non-linear state space models

Abstract

This paper concerns the use of sequential Monte Carlo methods (SMC) for smoothing in general state space models. A well-known problem when applying the standard SMC technique in the smoothing mode is that the resampling mechanism introduces degeneracy of the approximation in the path space. However, when performing maximum likelihood estimation via the EM algorithm, all functionals involved are of additive form for a large subclass of models. To cope with the problem in this case, a modification of the standard method (based on a technique proposed by Kitagawa and Sato) is suggested. Our algorithm relies on forgetting properties of the filtering dynamics and the quality of the estimates produced is investigated, both theoretically and via simulations.

Published in at http://dx.doi.org/10.3150/07-BEJ6150 the Bernoulli (http://isi.cbs.nl/bernoulli/) by the International Statistical Institute/Bernoulli Society (http://isi.cbs.nl/BS/bshome.htm)

Cited by in corpus (34)

• On Particle Methods for Parameter Estimation in State-Space Models
• Uniform Time Average Consistency of Monte Carlo Particle Filters
• Rao-Blackwellized particle smoothers for conditionally linear Gaussian models
• Sequential Monte Carlo Methods for System Identification
• Particle Metropolis-Hastings using gradient and Hessian information
• Nonlinear System Identification: Learning while respecting physical models using a sequential Monte Carlo method
• A probabilistic scheme for joint parameter estimation and state prediction in complex dynamical systems
• Nested particle filters for online parameter estimation in discrete-time state-space Markov models
• Derivative-Free Estimation of the Score Vector and Observed Information Matrix with Application to State-Space Models
• Identification of jump Markov linear models using particle filters
• On the use of backward simulation in particle Markov chain Monte Carlo methods
• Fast and numerically stable particle-based online additive smoothing: the AdaSmooth algorithm
• Online Particle Smoothing with Application to Map-matching
• On the auxiliary particle filter
• Efficient particle-based online smoothing in general hidden Markov models: the PaRIS algorithm
• Online Sequential Monte Carlo smoother for partially observed stochastic differential equations
• Particle-based adaptive-lag online marginal smoothing in general state-space models
• The Time Machine: A Simulation Approach for Stochastic Trees
• A graph/particle-based method for experiment design in nonlinear systems
• Model uncertainty estimation using the expectation maximization algorithm and a particle flow filter
• Statistical inference for dynamical systems: a review
• The Monte Carlo Transformer: a stochastic self-attention model for sequence prediction
• Learning dynamical systems with particle stochastic approximation EM
• Ensemble transport smoothing. Part I: Unified framework
• Inference for Partially Observed Multitype Branching Processes and Ecological Applications
• An efficient particle-based online EM algorithm for general state-space models
• Sequential Monte Carlo Methods for Option Pricing
• Rao-Blackwellized Particle Smoothing as Message Passing
• Towards Practical Bayesian Parameter and State Estimation
• Numerically stable online estimation of variance in particle filters
• Correlated pseudo-marginal Metropolis-Hastings using quasi-Newton proposals
• Efficient convergence through adaptive learning in sequential Monte Carlo Expectation Maximization
• Particle-based likelihood inference in partially observed diffusion processes using generalised Poisson estimators
• Efficient parameter inference in general hidden Markov models using the filter derivatives