Variational Marginal Particle Filters
arXiv:2109.15134
Abstract
Variational inference for state space models (SSMs) is known to be hard in general. Recent works focus on deriving variational objectives for SSMs from unbiased sequential Monte Carlo estimators. We reveal that the marginal particle filter is obtained from sequential Monte Carlo by applying Rao-Blackwellization operations, which sacrifices the trajectory information for reduced variance and differentiability. We propose the variational marginal particle filter (VMPF), which is a differentiable and reparameterizable variational filtering objective for SSMs based on an unbiased estimator. We find that VMPF with biased gradients gives tighter bounds than previous objectives, and the unbiased reparameterization gradients are sometimes beneficial.
arXiv commentAccepted to AISTATS 2022
References in corpus (21)
- Auto-Encoding Variational Bayes
- Categorical Reparameterization with Gumbel-Softmax
- Variational Inference with Normalizing Flows
- The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables
- A Recurrent Latent Variable Model for Sequential Data
- Markov Chain Monte Carlo and Variational Inference: Bridging the Gap
- Implicit Reparameterization Gradients
- Auto-Encoding Sequential Monte Carlo
- Variational Boosting: Iteratively Refining Posterior Approximations
- Stochastic Backpropagation through Mixture Density Distributions
- Nested Sequential Monte Carlo Methods
- Variational Gaussian Copula Inference
- Discriminative Particle Filter Reinforcement Learning for Complex Partial Observations
- Towards Differentiable Resampling
- The Variational Gaussian Process
- Differentiable Particle Filtering via Entropy-Regularized Optimal Transport
- Tensor Monte Carlo: particle methods for the GPU era
- Particle Smoothing Variational Objectives
- Learning Proposals for Probabilistic Programs with Inference Combinators
- Divide and Couple: Using Monte Carlo Variational Objectives for Posterior Approximation
- Copula-like Variational Inference