Differentiable Particle Filtering without Modifying the Forward Pass
arXiv:2106.10314
Abstract
Particle filters are not compatible with automatic differentiation due to the presence of discrete resampling steps. While known estimators for the score function, based on Fisher's identity, can be computed using particle filters, up to this point they required manual implementation. In this paper we show that such estimators can be computed using automatic differentiation, after introducing a simple correction to the particle weights. This correction utilizes the stop-gradient operator and does not modify the particle filter operation on the forward pass, while also being cheap and easy to compute. Surprisingly, with the same correction automatic differentiation also produces good estimators for gradients of expectations under the posterior. We can therefore regard our method as a general recipe for making particle filters differentiable. We additionally show that it produces desired estimators for second-order derivatives and how to extend it to further reduce variance at the expense of additional computation.
arXiv comment24 pages, 3 figures
References in corpus (14)
- Auto-Encoding Variational Bayes
- Stochastic Backpropagation and Approximate Inference in Deep Generative Models
- INTERACTION Dataset: An INTERnational, Adversarial and Cooperative moTION Dataset in Interactive Driving Scenarios with Semantic Maps
- Auto-Encoding Sequential Monte Carlo
- Pathwise Derivatives Beyond the Reparameterization Trick
- Black Box Variational Inference
- Stochastic Backpropagation through Mixture Density Distributions
- Toward Practical N2 Monte Carlo: the Marginal Particle Filter
- Tighter Variational Bounds are Not Necessarily Better
- Towards Differentiable Resampling
- Differentiable Particle Filtering via Entropy-Regularized Optimal Transport
- Storchastic: A Framework for General Stochastic Automatic Differentiation
- Loaded DiCE: Trading off Bias and Variance in Any-Order Score Function Estimators for Reinforcement Learning
- Variational Marginal Particle Filters