Particle Smoothing for Hidden Diffusion Processes: Adaptive Path Integral Smoother
arXiv:1605.00278 · doi:10.1109/TSP.2017.2686340
Abstract
Particle smoothing methods are used for inference of stochastic processes based on noisy observations. Typically, the estimation of the marginal posterior distribution given all observations is cumbersome and computational intensive. In this paper, we propose a simple algorithm based on path integral control theory to estimate the smoothing distribution of continuous-time diffusion processes with partial observations. In particular, we use an adaptive importance sampling method to improve the effective sampling size of the posterior over processes given the observations and the reliability of the estimation of the marginals. This is achieved by estimating a feedback controller to sample efficiently from the joint smoothing distributions. We compare the results with estimations obtained from the standard Forward Filter/Backward Simulator for two diffusion processes of different complexity. We show that the proposed method gives more reliable estimations than the standard FFBSi when the smoothing distribution is poorly represented by the filter distribution.
16 pages, 13 figures
References in corpus (3)
Cited by in corpus (11)
- Smooth Model Predictive Path Integral Control without Smoothing
- Data Assimilation: The Schrödinger Perspective
- Controlled Sequential Monte Carlo
- An Optimal Control Derivation of Nonlinear Smoothing Equations
- Adaptive Path-Integral Autoencoder: Representation Learning and Planning for Dynamical Systems
- Topology-Guided Path Integral Approach for Stochastic Optimal Control in Cluttered Environment
- Particle-based adaptive-lag online marginal smoothing in general state-space models
- A Multilevel Approach for Stochastic Nonlinear Optimal Control
- Adaptive Smoothing Path Integral Control
- Replica Conditional Sequential Monte Carlo
- Duality for nonlinear filtering