A comparison of Bayesian sampling algorithms for high-dimensional particle physics and cosmology applications

Abstract

For several decades now, Bayesian inference techniques have been applied to theories of particle physics, cosmology and astrophysics to obtain the probability density functions of their free parameters. In this study, we review and compare a wide range of Markov Chain Monte Carlo (MCMC) and nested sampling techniques to determine their relative efficacy on functions that resemble those encountered most frequently in the particle astrophysics literature. Our first series of tests explores a series of high-dimensional analytic test functions that exemplify particular challenges, for example highly multimodal posteriors or posteriors with curving degeneracies. We then investigate two real physics examples, the first being a global fit of the $\Lambda$CDM model using cosmic microwave background data from the Planck experiment, and the second being a global fit of the Minimal Supersymmetric Standard Model using a wide variety of collider and astrophysics data. We show that several examples widely thought to be most easily solved using nested sampling approaches can in fact be more efficiently solved using modern MCMC algorithms, but the details of the implementation matter. Furthermore, we also provide a series of useful insights for practitioners of particle astrophysics and cosmology.

45 pages, 8 figures, 20 tables

References in corpus (68)

• emcee: The MCMC Hammer
• Cosmological parameters from CMB and other data: a Monte-Carlo approach
• MultiNest: an efficient and robust Bayesian inference tool for cosmology and particle physics
• dynesty: A Dynamic Nested Sampling Package for Estimating Bayesian Posteriors and Evidences
• Rank-normalization, folding, and localization: An improved $\hat{R}$ for assessing convergence of MCMC
• Parallel Tempering: Theory, Applications, and New Perspectives
• Bilby: A user-friendly Bayesian inference library for gravitational-wave astronomy
• The pseudo-marginal approach for efficient Monte Carlo computations
• 2020 Global reassessment of the neutrino oscillation picture
• PolyChord: next-generation nested sampling
• The Cosmic Linear Anisotropy Solving System (CLASS) IV: Efficient implementation of non-cold relics
• Global constraints on absolute neutrino masses and their ordering
• Data analysis recipes: Using Markov Chain Monte Carlo
• Dynamic temperature selection for parallel-tempering in Markov chain Monte Carlo simulations
• Dynamic nested sampling: an improved algorithm for parameter estimation and evidence calculation
• emcee v3: A Python ensemble sampling toolkit for affine-invariant MCMC
• Markov Chain Monte Carlo Methods for Bayesian Data Analysis in Astronomy
• A statistical test for Nested Sampling algorithms
• Collaborative Nested Sampling: Big Data vs. complex physical models
• A Markov Chain Monte Carlo Analysis of the CMSSM
• Status of the scalar singlet dark matter model
• COSMOPOWER: emulating cosmological power spectra for accelerated Bayesian inference from next-generation surveys
• II: Bayesian Methods for Cosmological Parameter Estimation from Cosmic Microwave Background Measurements
• Global analyses of Higgs portal singlet dark matter models using GAMBIT
• GAMBIT: The Global and Modular Beyond-the-Standard-Model Inference Tool
• $\text{HEPfit}$: a Code for the Combination of Indirect and Direct Constraints on High Energy Physics Models
• Nested Sampling Methods
• A global fit of the MSSM with GAMBIT
• anesthetic: nested sampling visualisation
• Prediction for the Lightest Higgs Boson Mass in the CMSSM using Indirect Experimental Constraints
• Impact of vacuum stability, perturbativity and XENON1T on global fits of ${\mathbb{Z}}_2$ and ${\mathbb{Z}}_3$ scalar singlet dark matter
• Bilby-MCMC: An MCMC sampler for gravitational-wave inference
• Forecast for cosmological parameter estimation with gravitational-wave standard sirens from the LISA-Taiji network
• Global analysis of electroweak data in the Standard Model
• zeus: A Python implementation of Ensemble Slice Sampling for efficient Bayesian parameter inference
• Implications for New Physics in $b\to s\mu \mu$ transitions after recent measurements by Belle and LHCb
• Rethinking the Effective Sample Size
• Combined analysis of AMS-02 (Li,Be,B)/C, N/O, 3He, and 4He data
• Back to (Mass-)Square(d) One: The Neutrino Mass Ordering in Light of Recent Data
• Combined Constraints on First Generation Leptoquarks
• Frequentist Analysis of the Parameter Space of Minimal Supergravity
• Fast and Credible Likelihood-Free Cosmology with Truncated Marginal Neural Ratio Estimation
• Bayesian Approach to Inverse Problems: an Application to NNPDF Closure Testing
• Sampling Errors in Nested Sampling Parameter Estimation
• Bayesian global analysis of neutrino oscillation data
• nestcheck: diagnostic tests for nested sampling calculations
• Importance nested sampling with normalising flows
• Bayesian evidence for the tensor-to-scalar ratio $r$ and neutrino masses $m_{\nu }$: Effects of uniform vs logarithmic priors
• Constraining the CP structure of Higgs-fermion couplings with a global LHC fit, the electron EDM and baryogenesis
• A Step Toward Model Comparison: Connecting Electroweak-Scale Observables to BSM through EFT and Bayesian Statistics
• Bayesian constraints on the astrophysical neutrino source population from IceCube data
• Euclid: Forecast constraints on consistency tests of the $\Lambda$CDM model
• DAMPE squib? Significance of the 1.4 TeV DAMPE excess
• A comparison of optimisation algorithms for high-dimensional particle and astrophysics applications
• Nested sampling cross-checks using order statistics
• Fast supersymmetry phenomenology at the Large Hadron Collider using machine learning techniques
• The CMSSM Survives Planck, the LHC, LUX-ZEPLIN, Fermi-LAT, H.E.S.S. and IceCube
• Left-right symmetry and electric dipole moments. A global analysis
• Global fits of simplified models for dark matter with GAMBIT I. Scalar and fermionic models with s-channel vector mediators
• A GREAT model comparison against the cosmological constant
• Machine learning of log-likelihood functions in global analysis of parton distributions
• Empirical inference on the Majorana mass of the ordinary neutrinos
• Global fits of simplified models for dark matter with GAMBIT II. Vector dark matter with an $s$-channel vector mediator
• Comparison of Step Samplers for Nested Sampling
• Nested sampling for frequentist computation: fast estimation of small $p$-values
• QFitter -- A Quantum Fitting Framework Applied to Effective Field Theories
• Bayesian Approach for Counting Experiment Statistics applied to a Neutrino Point Source Analysis
• inclusiveAI: A machine learning representation of the $F_2$ structure function over all charted $Q^2$ and $x$ range

Cited by in corpus (2)

• The CosmoVerse White Paper: Addressing observational tensions in cosmology with systematics and fundamental physics
• Inferring correlated distributions: boosted top jets