A comparison of Bayesian sampling algorithms for high-dimensional particle physics and cosmology applications

Abstract

For several decades now, Bayesian inference techniques have been applied to theories of particle physics, cosmology and astrophysics to obtain the probability density functions of their free parameters. In this study, we review and compare a wide range of Markov Chain Monte Carlo (MCMC) and nested sampling techniques to determine their relative efficacy on functions that resemble those encountered most frequently in the particle astrophysics literature. Our first series of tests explores a series of high-dimensional analytic test functions that exemplify particular challenges, for example highly multimodal posteriors or posteriors with curving degeneracies. We then investigate two real physics examples, the first being a global fit of the $\Lambda$CDM model using cosmic microwave background data from the Planck experiment, and the second being a global fit of the Minimal Supersymmetric Standard Model using a wide variety of collider and astrophysics data. We show that several examples widely thought to be most easily solved using nested sampling approaches can in fact be more efficiently solved using modern MCMC algorithms, but the details of the implementation matter. Furthermore, we also provide a series of useful insights for practitioners of particle astrophysics and cosmology.

45 pages, 8 figures, 20 tables

References in corpus (29)

• The pseudo-marginal approach for efficient Monte Carlo computations
• emcee v3: A Python ensemble sampling toolkit for affine-invariant MCMC
• Markov Chain Monte Carlo Methods for Bayesian Data Analysis in Astronomy
• A statistical test for Nested Sampling algorithms
• COSMOPOWER: emulating cosmological power spectra for accelerated Bayesian inference from next-generation surveys
• anesthetic: nested sampling visualisation
• Prediction for the Lightest Higgs Boson Mass in the CMSSM using Indirect Experimental Constraints
• Bilby-MCMC: An MCMC sampler for gravitational-wave inference
• Global analysis of electroweak data in the Standard Model
• zeus: A Python implementation of Ensemble Slice Sampling for efficient Bayesian parameter inference
• Frequentist Analysis of the Parameter Space of Minimal Supergravity
• Fast and Credible Likelihood-Free Cosmology with Truncated Marginal Neural Ratio Estimation
• Bayesian Approach to Inverse Problems: an Application to NNPDF Closure Testing
• Importance nested sampling with normalising flows
• Bayesian evidence for the tensor-to-scalar ratio $r$ and neutrino masses $m_{\nu }$: Effects of uniform vs logarithmic priors
• Constraining the CP structure of Higgs-fermion couplings with a global LHC fit, the electron EDM and baryogenesis
• Euclid: Forecast constraints on consistency tests of the $\Lambda$CDM model
• Nested sampling cross-checks using order statistics
• The CMSSM Survives Planck, the LHC, LUX-ZEPLIN, Fermi-LAT, H.E.S.S. and IceCube
• Left-right symmetry and electric dipole moments. A global analysis
• Global fits of simplified models for dark matter with GAMBIT I. Scalar and fermionic models with s-channel vector mediators
• Machine learning of log-likelihood functions in global analysis of parton distributions
• A GREAT model comparison against the cosmological constant
• Empirical inference on the Majorana mass of the ordinary neutrinos
• Global fits of simplified models for dark matter with GAMBIT II. Vector dark matter with an $s$-channel vector mediator
• Comparison of Step Samplers for Nested Sampling
• Nested sampling for frequentist computation: fast estimation of small $p$-values
• QFitter -- A Quantum Fitting Framework Applied to Effective Field Theories
• inclusiveAI: A machine learning representation of the $F_2$ structure function over all charted $Q^2$ and $x$ range

Cited by in corpus (2)

• The CosmoVerse White Paper: Addressing observational tensions in cosmology with systematics and fundamental physics
• Inferring correlated distributions: boosted top jets