Variational Sequential Monte Carlo
arXiv:1705.11140
Abstract
Many recent advances in large scale probabilistic inference rely on variational methods. The success of variational approaches depends on (i) formulating a flexible parametric family of distributions, and (ii) optimizing the parameters to find the member of this family that most closely approximates the exact posterior. In this paper we present a new approximating family of distributions, the variational sequential Monte Carlo (VSMC) family, and show how to optimize it in variational inference. VSMC melds variational inference (VI) and sequential Monte Carlo (SMC), providing practitioners with flexible, accurate, and powerful Bayesian inference. The VSMC family is a variational family that can approximate the posterior arbitrarily well, while still allowing for efficient optimization of its parameters. We demonstrate its utility on state space models, stochastic volatility models for financial data, and deep Markov models of brain neural circuits.
References in corpus (5)
Cited by in corpus (13)
- KalmanNet: Neural Network Aided Kalman Filtering for Partially Known Dynamics
- Dynamical Variational Autoencoders: A Comprehensive Review
- State Space LSTM Models with Particle MCMC Inference
- Nonlinear System Identification: Learning while respecting physical models using a sequential Monte Carlo method
- A Survey of Bayesian Statistical Approaches for Big Data
- Particle Filter Networks with Application to Visual Localization
- Streaming Variational Monte Carlo
- Bayesian Multi-Task Transfer Learning for Soft Prompt Tuning
- AIDE: An algorithm for measuring the accuracy of probabilistic inference algorithms
- The Monte Carlo Transformer: a stochastic self-attention model for sequence prediction
- Learning Nonlinear State Space Models with Hamiltonian Sequential Monte Carlo Sampler
- Tree-based Particle Smoothing Algorithms in a Hidden Markov Model
- Filtering Variational Objectives