Nested sampling for physical scientists

Abstract

We review Skilling's nested sampling (NS) algorithm for Bayesian inference and more broadly multi-dimensional integration. After recapitulating the principles of NS, we survey developments in implementing efficient NS algorithms in practice in high-dimensions, including methods for sampling from the so-called constrained prior. We outline the ways in which NS may be applied and describe the application of NS in three scientific fields in which the algorithm has proved to be useful: cosmology, gravitational-wave astronomy, and materials science. We close by making recommendations for best practice when using NS and by summarizing potential limitations and optimizations of NS.

arXiv comment20 pages + supplementary information, 5 figures. preprint version; published version at https://www.nature.com/articles/s43586-022-00121-x

References in corpus (129)

• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• Observational Evidence from Supernovae for an Accelerating Universe and a Cosmological Constant
• Measurements of Omega and Lambda from 42 High-Redshift Supernovae
• Observation of Gravitational Waves from a Binary Black Hole Merger
• First Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Determination of Cosmological Parameters
• Advanced Virgo: a 2nd generation interferometric gravitational wave detector
• Cosmological parameters from CMB and other data: a Monte-Carlo approach
• Advanced LIGO
• GW151226: Observation of Gravitational Waves from a 22-Solar-Mass Binary Black Hole Coalescence
• MCMC using Hamiltonian dynamics
• Global Optimization by Basin-Hopping and the Lowest Energy Structures of Lennard-Jones Clusters Containing up to 110 Atoms
• MultiNest: an efficient and robust Bayesian inference tool for cosmology and particle physics
• An efficient, multiple range random walk algorithm to calculate the density of states
• dynesty: A Dynamic Nested Sampling Package for Estimating Bayesian Posteriors and Evidences
• A Supersymmetry Primer
• GWTC-3: Compact Binary Coalescences Observed by LIGO and Virgo During the Second Part of the Third Observing Run
• Planck 2013 results. I. Overview of products and scientific results
• Multimodal nested sampling: an efficient and robust alternative to MCMC methods for astronomical data analysis
• Characterization of the LIGO detectors during their sixth science run
• Bayes in the sky: Bayesian inference and model selection in cosmology
• Dark Energy Survey Year 1 Results: Cosmological Constraints from Galaxy Clustering and Weak Lensing
• Cosmological Parameters from Observations of Galaxy Clusters
• Importance Nested Sampling and the MultiNest Algorithm
• Robust parameter estimation for compact binaries with ground-based gravitational-wave observations using the LALInference software library
• Supernova Constraints and Systematic Uncertainties from the First 3 Years of the Supernova Legacy Survey
• KiDS-1000 Cosmology: Cosmic shear constraints and comparison between two point statistics
• Formalising the Slow-Roll Approximation in Inflation
• Efficient sampling of fast and slow cosmological parameters
• PolyChord: nested sampling for cosmology
• PolyChord: next-generation nested sampling
• Bayesian inference for compact binary coalescences with BILBY: Validation and application to the first LIGO--Virgo gravitational-wave transient catalogue
• Dynamical dark energy in light of the latest observations
• An introduction to Bayesian inference in gravitational-wave astronomy: parameter estimation, model selection, and hierarchical models
• Curvature tension: evidence for a closed universe
• A Nested Sampling Algorithm for Cosmological Model Selection
• The Neutrino Puzzle: Anomalies, Interactions, and Cosmological Tensions
• Constraints on cosmic-ray propagation models from a global Bayesian analysis
• Data analysis recipes: Using Markov Chain Monte Carlo
• Dynamic nested sampling: an improved algorithm for parameter estimation and evidence calculation
• Cosmological constraints from the X-ray gas mass fraction in relaxed lensing clusters observed with Chandra
• A Short History of Markov Chain Monte Carlo: Subjective Recollections from Incomplete Data
• Bayesian coherent analysis of in-spiral gravitational wave signals with a detector network
• A statistical test for Nested Sampling algorithms
• Gravitational waves from neutron star mergers and their relation to the nuclear equation of state
• Model selection and parameter inference in phylogenetics using Nested Sampling
• Collaborative Nested Sampling: Big Data vs. complex physical models
• A Markov Chain Monte Carlo Analysis of the CMSSM
• Validating Bayesian Inference Algorithms with Simulation-Based Calibration
• The impact of priors and observables on parameter inferences in the Constrained MSSM
• Massively parallel Bayesian inference for transient gravitational-wave astronomy
• KiDS+VIKING-450 and DES-Y1 combined: Cosmology with cosmic shear
• The BayesWave analysis pipeline in the era of gravitational wave observations
• HELIOS-Retrieval: An Open-source, Nested Sampling Atmospheric Retrieval Code, Application to the HR 8799 Exoplanets and Inferred Constraints for Planet Formation
• Model comparison from LIGO-Virgo data on GW170817's binary components and consequences for the merger remnant
• An information-theoretic approach to the gravitational-wave burst detection problem
• Extraction of Gravitational Waves in Numerical Relativity
• Nested Sampling with Normalising Flows for Gravitational-Wave Inference
• Constrained MSSM favoring new territories: The impact of new LHC limits and a 125 GeV Higgs boson
• Efficient Bayesian inference for multimodal problems in cosmology
• Fitting the Phenomenological MSSM
• Properties of Nested Sampling
• Testable Baryogenesis in Seesaw Models
• A Bayesian model selection analysis of WMAP3
• Searches for Gravitational Waves from Known Pulsars at Two Harmonics in 2015-2017 LIGO Data
• Quantifying tensions in cosmological parameters: Interpreting the DES evidence ratio
• The CMSSM and NUHM1 after LHC Run 1
• anesthetic: nested sampling visualisation
• Improved constraints on cosmological parameters from SNIa data
• Helios-r2 -- A new Bayesian, open-source retrieval model for brown dwarfs and exoplanet atmospheres
• Bayesian Evidence and Model Selection
• Updated global fits of the cMSSM including the latest LHC SUSY and Higgs searches and XENON100 data
• A Profile Likelihood Analysis of the Constrained MSSM with Genetic Algorithms
• Inferring the core-collapse supernova explosion mechanism with gravitational waves
• Dark matter and collider signatures of the MSSM
• Hunting Down the Best Model of Inflation with Bayesian Evidence
• Challenges of Profile Likelihood Evaluation in Multi-Dimensional SUSY Scans
• Global fits of the dark matter-nucleon effective interactions
• A General Bayesian Framework for Foreground Modelling and Chromaticity Correction for Global 21cm Experiments
• Comparison of sampling techniques for Bayesian parameter estimation
• Effect of calibration errors on Bayesian parameter estimation for gravitational wave signals from inspiral binary systems in the advanced detectors era
• The pMSSM10 after LHC Run 1
• Computational methods for Bayesian model choice
• Determining pressure-temperature phase diagrams of materials
• Comparison of statistical sampling methods with ScannerBit, the GAMBIT scanning module
• Thermodynamics of supercooled liquids in the inherent structure formalism: a case study
• On the Feasibility of Intense Radial Velocity Surveys for Earth-twin Discoveries
• A Bayesian approach to the follow-up of candidate gravitational wave signals
• Fast Bayesian Inference for Exoplanet Discovery in Radial Velocity Data
• Pippi - painless parsing, post-processing and plotting of posterior and likelihood samples
• Measurement of the charged pion mass using X-ray spectroscopy of exotic atoms
• Sampling Errors in Nested Sampling Parameter Estimation
• nestcheck: diagnostic tests for nested sampling calculations
• Recursive Pathways to Marginal Likelihood Estimation with Prior-Sensitivity Analysis
• Bayesian inflationary reconstructions from Planck 2018 data
• Constant-pressure nested sampling with atomistic dynamics
• Bayesian evidence for the tensor-to-scalar ratio $r$ and neutrino masses $m_{\nu }$: Effects of uniform vs logarithmic priors
• Bayesian modelling of clusters of galaxies from multi-frequency pointed Sunyaev--Zel'dovich observations
• Strengthening the bound on the mass of the lightest neutrino with terrestrial and cosmological experiments
• Constraining the dark energy equation of state using Bayes theorem and the Kullback-Leibler divergence
• High-precision measurements of $n=2\to n=1$ transition energies and level widths in He- and Be-like Argon Ions
• On statistical uncertainty in nested sampling
• Superplot: a graphical interface for plotting and analysing MultiNest output
• Modelling gravitational waves from precessing black-hole binaries: Progress, challenges and prospects
• Constraining the kinetically dominated Universe
• CosmoBit: A GAMBIT module for computing cosmological observables and likelihoods
• Accelerated Bayesian inference using deep learning
• Bayesian data analysis tools for atomic physics
• The HARPS search for southern extra-solar planets XLV. Two Neptune mass planets orbiting HD 13808: a study of stellar activity modelling's impact on planet detection
• A comparison of optimisation algorithms for high-dimensional particle and astrophysics applications
• Nested sampling cross-checks using order statistics
• On the performance of interatomic potential models of iron: comparison of the phase diagrams
• New Test of Modulated Electron Capture Decay of Hydrogen-Like ${}^{142}$Pm Ions: Precision Measurement of Purely Exponential Decay
• Simple and statistically sound recommendations for analysing physical theories
• Nested sampling with any prior you like
• Bayesian analysis of weak gravitational lensing and Sunyaev-Zel'dovich data for six galaxy clusters
• Initializing adaptive importance sampling with Markov chains
• Mean shift cluster recognition method implementation in the nested sampling algorithm
• Dynamical computation of the density of states and Bayes factors using nonequilibrium importance sampling
• Bayesian sparse reconstruction: a brute-force approach to astronomical imaging and machine learning
• Nested sampling with plateaus
• A Thesaurus for Common Priors in Gravitational-Wave Astronomy
• Insight into liquid polymorphism from the complex phase behaviour of a simple model
• The Nested_fit data analysis program
• Line shape analysis of the K$\beta$ transition in muonic hydrogen
• Nested sampling for frequentist computation: fast estimation of small $p$-values
• Nested Sampling And Likelihood Plateaus
• Split Sampling: Expectations, Normalisation and Rare Events
• DIAMONDS: A new Bayesian nested sampling tool
• NEO: Non Equilibrium Sampling on the Orbit of a Deterministic Transform

Cited by in corpus (62)

• The Science of the Einstein Telescope
• Forming intracluster gas in a galaxy protocluster at a redshift of 2.16
• Cosmological constraints on decaying axion-like particles: a global analysis
• Where intermediate-mass black holes could hide in the Galactic Centre: A full parameter study with the S2 orbit
• Accelerating the prediction of inorganic surfaces with machine learning interatomic potentials
• Structure, short-range order, and phase stability of the Al${}_x$CrFeCoNi high-entropy alloy: Insights from a perturbative, DFT-based analysis
• A general-purpose machine learning Pt interatomic potential for an accurate description of bulk, surfaces and nanoparticles
• Applications of machine learning in gravitational wave research with current interferometric detectors
• Bayesian model comparison for simulation-based inference
• Genuine Retrieval of the AGN Host Stellar Population (GRAHSP)
• Scalable inference with Autoregressive Neural Ratio Estimation
• Cosmological Tests of $f(R,G,T)$ Dark Energy Model in FRW Universe
• Feeding and feedback processes in the Spiderweb proto-intracluster medium
• Cross-Comparison of Sampling Algorithms for Pulse Profile Modeling of PSR J0740+6620
• Multipole tidal effects in the post-Newtonian gravitational-wave phase of compact binary coalescences
• Surface Phase Diagrams from Nested Sampling
• The Bayes factor surface for searches for new physics
• A framework to measure the properties of intergalactic metal systems with two-point flux statistics
• Exploring phase space with Nested Sampling
• X-ray diagnostics of Cassiopeia A's "Green Monster": evidence for dense shocked circumstellar plasma
• Simulation-based inference of black hole ringdowns in the time domain
• Bayesian $\mathcal{F}$-statistic-based parameter estimation of continuous gravitational waves from known pulsars
• Comparison of Step Samplers for Nested Sampling
• Accelerating Tests of General Relativity with Gravitational-Wave Signals using Hybrid Sampling
• Efficient Bayesian inference and model selection for continuous gravitational waves in pulsar timing array data
• The mass distribution of the first stars can be determined via the 21-cm signal
• Probing intractable beyond-standard-model parameter spaces armed with Machine Learning
• Can molecular dynamics be used to simulate biomolecular recognition?
• Trial by FIRE: Probing the dark matter density profile of dwarf galaxies with GraphNPE
• Bayesian insights in Tycho supernova remnant : a detailed mapping of ejecta properties
• Replica exchange nested sampling
• Bayesian reconstruction of primordial perturbations from induced gravitational waves
• Fast and accurate parameter estimation of high-redshift sources with the Einstein Telescope
• Bayesian pulsar timing and noise analysis with Vela.jl: an overview
• Cosmological Parameter Estimation with a Joint-Likelihood Analysis of the Cosmic Microwave Background and Big Bang Nucleosynthesis
• Calculating Bayesian evidence for inflationary models using CONNECT
• Bayesian Active Search on Parameter Space: a 95 GeV Spin-0 Resonance in the ($B-L$)SSM
• BraWl: Simulating the thermodynamics and phase stability of multicomponent alloys using conventional and enhanced sampling techniques
• Population synthesis and parameter estimation of neutron stars with continuous gravitational waves and third-generation detectors
• Kernel-, mean- and noise-marginalised Gaussian processes for exoplanet transits and $H_0$ inference
• Detecting non-thermal emission in a solar microflare using nested sampling
• Comparison of $\Lambda$CDM and $R_h=ct$ with updated galaxy cluster $f_{gas}$ measurements using Bayesian inference
• Searching for unresolved massive black hole pairs through AGN photometric variability
• The NANOGrav 15 yr Data Set: Customized Chromatic Noise Models
• Bayesian and Monte Carlo approaches to estimating uncertainty for the measurement of the bound-state $\beta$ decay of ${}^{205}{\mathrm{Tl}}^{81+}$
• Reducing systematic uncertainties in gravitational-wave population analyses by increasing the detection threshold
• Harmonic-to-anharmonic thermodynamic integration made simple using REG TI
• Nested Sampling for Exploring Lennard-Jones Clusters
• The Sequential Monte Carlo goes NUTS: Boosting Gravitational-Wave Inference
• Nested sampling statistical errors
• Calibrating Bayesian Tension Statistics using Neural Ratio Estimation
• Towards a Field Based Bayesian Evidence Inference from Nested Sampling Data
• A Bayesian Approach for Strong Field QED Tests with He-like Ions
• An Order Statistics Post-Mortem on LIGO-Virgo GWTC-2 Events Analysed with Nested Sampling
• $\text{Exoformer}$: Accelerating Bayesian atmospheric retrievals with transformer neural networks
• Resonances in reflective Hamiltonian Monte Carlo
• Measuring the crust-superfluid coupling time-scale for 105 UTMOST pulsars with a Kalman filter
• Partition function approach to non-Gaussian likelihoods: macrocanonical partitions and replicating Markov-chains
• Adsorbate phase transitions on nanoclusters from nested sampling
• FreeBird.jl: An Extensible Toolbox for Simulating Interfacial Phase Equilibria
• Probing the partition function for temperature-dependent potentials with nested sampling
• Quantile Importance Sampling