Normalizing Constant Estimation with Gaussianized Bridge Sampling

Abstract

Normalizing constant (also called partition function, Bayesian evidence, or marginal likelihood) is one of the central goals of Bayesian inference, yet most of the existing methods are both expensive and inaccurate. Here we develop a new approach, starting from posterior samples obtained with a standard Markov Chain Monte Carlo (MCMC). We apply a novel Normalizing Flow (NF) approach to obtain an analytic density estimator from these samples, followed by Optimal Bridge Sampling (OBS) to obtain the normalizing constant. We compare our method which we call Gaussianized Bridge Sampling (GBS) to existing methods such as Nested Sampling (NS) and Annealed Importance Sampling (AIS) on several examples, showing our method is both significantly faster and substantially more accurate than these methods, and comes with a reliable error estimation.

arXiv commentAccepted by AABI 2019 Proceedings

References in corpus (5)

• dynesty: A Dynamic Nested Sampling Package for Estimating Bayesian Posteriors and Evidences
• NICE: Non-linear Independent Components Estimation
• Importance Nested Sampling and the MultiNest Algorithm
• PolyChord: next-generation nested sampling
• Sandwiching the marginal likelihood using bidirectional Monte Carlo

Cited by in corpus (2)

• The look-elsewhere effect from a unified Bayesian and frequentist perspective
• A flexible parameterization to test early physics solutions to the Hubble tension with future CMB data