Sequential Kalman Tuning of the $t$-preconditioned Crank-Nicolson algorithm: efficient, adaptive and gradient-free inference for Bayesian inverse problems

Abstract

Ensemble Kalman Inversion (EKI) has been proposed as an efficient method for the approximate solution of Bayesian inverse problems with expensive forward models. However, when applied to the Bayesian inverse problem EKI is only exact in the regime of Gaussian target measures and linear forward models. In this work we propose embedding EKI and Flow Annealed Kalman Inversion (FAKI), its normalizing flow (NF) preconditioned variant, within a Bayesian annealing scheme as part of an adaptive implementation of the $t$-preconditioned Crank-Nicolson (tpCN) sampler. The tpCN sampler differs from standard pCN in that its proposal is reversible with respect to the multivariate $t$-distribution. The more flexible tail behaviour allows for better adaptation to sampling from non-Gaussian targets. Within our Sequential Kalman Tuning (SKT) adaptation scheme, EKI is used to initialize and precondition the tpCN sampler for each annealed target. The subsequent tpCN iterations ensure particles are correctly distributed according to each annealed target, avoiding the accumulation of errors that would otherwise impact EKI. We demonstrate the performance of SKT for tpCN on three challenging numerical benchmarks, showing significant improvements in the rate of convergence compared to adaptation within standard SMC with importance weighted resampling at each temperature level, and compared to similar adaptive implementations of standard pCN. The SKT scheme applied to tpCN offers an efficient, practical solution for solving the Bayesian inverse problem when gradients of the forward model are not available. Code implementing the SKT schemes for tpCN is available at \url{https://github.com/RichardGrumitt/KalmanMC}.

58 pages, 22 figures, accepted in Inverse Problems

References in corpus (17)

• emcee: The MCMC Hammer
• Cosmological parameters from CMB and other data: a Monte-Carlo approach
• MCMC using Hamiltonian dynamics
• The Cosmic Linear Anisotropy Solving System (CLASS) II: Approximation schemes
• The Ensemble Kalman Filter for Inverse Problems
• On adaptive resampling strategies for sequential Monte Carlo methods
• Ensemble Kalman Inversion: A Derivative-Free Technique For Machine Learning Tasks
• On the Convergence of the Ensemble Kalman Filter
• Spectral gaps for a Metropolis-Hastings algorithm in infinite dimensions
• A regularizing iterative ensemble Kalman method for PDE-constrained inverse problems
• Improving Simulation Efficiency of MCMC for Inverse Modeling of Hydrologic Systems with a Kalman-Inspired Proposal Distribution
• Parameterizations for Ensemble Kalman Inversion
• Accelerating astronomical and cosmological inference with Preconditioned Monte Carlo
• Bayesian inversion in resin transfer molding
• Ensemble Kalman Inversion for nonlinear problems: weights, consistency, and variance bounds
• Ensemble Kalman Inversion for General Likelihoods
• Adaptive Tuning for Metropolis Adjusted Langevin Trajectories

Cited by in corpus (1)

• Validating Sequential Monte Carlo for Gravitational-Wave Inference