Proximal nested sampling for high-dimensional Bayesian model selection

Abstract

Bayesian model selection provides a powerful framework for objectively comparing models directly from observed data, without reference to ground truth data. However, Bayesian model selection requires the computation of the marginal likelihood (model evidence), which is computationally challenging, prohibiting its use in many high-dimensional Bayesian inverse problems. With Bayesian imaging applications in mind, in this work we present the proximal nested sampling methodology to objectively compare alternative Bayesian imaging models for applications that use images to inform decisions under uncertainty. The methodology is based on nested sampling, a Monte Carlo approach specialised for model comparison, and exploits proximal Markov chain Monte Carlo techniques to scale efficiently to large problems and to tackle models that are log-concave and not necessarily smooth (e.g., involving l_1 or total-variation priors). The proposed approach can be applied computationally to problems of dimension O(10^6) and beyond, making it suitable for high-dimensional inverse imaging problems. It is validated on large Gaussian models, for which the likelihood is available analytically, and subsequently illustrated on a range of imaging problems where it is used to analyse different choices of dictionary and measurement model.

References in corpus (17)

• MultiNest: an efficient and robust Bayesian inference tool for cosmology and particle physics
• Multimodal nested sampling: an efficient and robust alternative to MCMC methods for astronomical data analysis
• PolyChord: nested sampling for cosmology
• A Nested Sampling Algorithm for Cosmological Model Selection
• Applications of Bayesian model selection to cosmological parameters
• A Survey of Stochastic Simulation and Optimization Methods in Signal Processing
• Is the Jeffreys' scale a reliable tool for Bayesian model comparison in cosmology?
• Properties of Nested Sampling
• On Variable Density Compressive Sampling
• Layered Adaptive Importance Sampling
• Uncertainty quantification for radio interferometric imaging: I. proximal MCMC methods
• Exploring Multi-Modal Distributions with Nested Sampling
• On the safe use of prior densities for Bayesian model selection
• Nested Sampling with Constrained Hamiltonian Monte Carlo
• Sampling from a log-concave distribution with compact support with proximal Langevin Monte Carlo
• Fast Gibbs sampling for high-dimensional Bayesian inversion
• Machine learning assisted Bayesian model comparison: learnt harmonic mean estimator

Cited by in corpus (5)

• Bayesian model comparison for simulation-based inference
• Bayesian evidence estimation from posterior samples with normalizing flows
• Posterior sampling for inverse imaging problems on the sphere in seismology and cosmology
• Learned Interferometric Imaging for the SPIDER Instrument
• Granulation signatures in 3D hydrodynamical simulations: evaluating background model performance using a Bayesian nested sampling framework