Multilevel Sequential Monte Carlo Samplers

Abstract

In this article we consider the approximation of expectations w.r.t. probability distributions associated to the solution of partial differential equations (PDEs); this scenario appears routinely in Bayesian inverse problems. In practice, one often has to solve the associated PDE numerically, using, for instance finite element methods and leading to a discretisation bias, with the step-size level $h_L$. In addition, the expectation cannot be computed analytically and one often resorts to Monte Carlo methods. In the context of this problem, it is known that the introduction of the multilevel Monte Carlo (MLMC) method can reduce the amount of computational effort to estimate expectations, for a given level of error. This is achieved via a telescoping identity associated to a Monte Carlo approximation of a sequence of probability distributions with discretisation levels $\infty >h_0>h_1\cdots >h_L$. In many practical problems of interest, one cannot achieve an i.i.d. sampling of the associated sequence of probability distributions. A sequential Monte Carlo (SMC) version of the MLMC method is introduced to deal with this problem. It is shown that under appropriate assumptions, the attractive property of a reduction of the amount of computational effort to estimate expectations, for a given level of error, can be maintained within the SMC context.

References in corpus (3)

• On adaptive resampling strategies for sequential Monte Carlo methods
• Sharp failure rates for the bootstrap particle filter in high dimensions
• Multilevel Sequential Monte Carlo Samplers for Normalizing Constants

Cited by in corpus (31)

• Simulation and inference algorithms for stochastic biochemical reaction networks: from basic concepts to state-of-the-art
• Multilevel Sequential${}^2$ Monte Carlo for Bayesian Inverse Problems
• Multilevel rejection sampling for approximate Bayesian computation
• Bayesian multiscale deep generative model for the solution of high-dimensional inverse problems
• Multilevel Sequential Importance Sampling for Rare Event Estimation
• Multifidelity multilevel Monte Carlo to accelerate approximate Bayesian parameter inference for partially observed stochastic processes
• Modern Monte Carlo Methods for Efficient Uncertainty Quantification and Propagation: A Survey
• Central Limit Theorems for Coupled Particle Filters
• Correction of coarse-graining errors by a two-level method: application to the Asakura-Oosawa model
• Analysis of nested multilevel Monte Carlo using approximate Normal random variables
• Multilevel Sequential Monte Carlo Samplers for Normalizing Constants
• Multilevel adaptive sparse Leja approximations for Bayesian inverse problems
• Multi-index ensemble Kalman filtering
• Antithetic Multilevel Particle Filters
• On Coupling Particle Filter Trajectories
• Tree-based Particle Smoothing Algorithms in a Hidden Markov Model
• Forward and Inverse Uncertainty Quantification using Multilevel Monte Carlo Algorithms for an Elliptic Nonlocal Equation
• Multilevel Sequential Monte Carlo with Dimension-Independent Likelihood-Informed Proposals
• Multilevel Monte Carlo in Approximate Bayesian Computation
• Unbiased Estimation of the Gradient of the Log-Likelihood in Inverse Problems
• Constrained Ensemble Langevin Monte Carlo
• Operator-Based Uncertainty Quantification of Stochastic Fractional PDEs
• Multilevel simulation of hard-sphere mixtures
• Multilevel higher order Quasi-Monte Carlo Bayesian Estimation
• Importance sampling for a robust and efficient multilevel Monte Carlo estimator for stochastic reaction networks
• A Multilevel Monte Carlo Estimator for Matrix Multiplication
• FLARE MCMC: Fidelity-based Layer-Adaptive REcursive proposals for MCMC
• Unbiased Multi-index Monte Carlo
• Multilevel Stein variational gradient descent with applications to Bayesian inverse problems
• Multi-Index Sequential Monte Carlo Methods for partially observed Stochastic Partial Differential Equations
• Critical point for de-mixing of binary hard spheres