Nested Sampling Methods

Abstract

Nested sampling (NS) computes parameter posterior distributions and makes Bayesian model comparison computationally feasible. Its strengths are the unsupervised navigation of complex, potentially multi-modal posteriors until a well-defined termination point. A systematic literature review of nested sampling algorithms and variants is presented. We focus on complete algorithms, including solutions to likelihood-restricted prior sampling, parallelisation, termination and diagnostics. The relation between number of live points, dimensionality and computational cost is studied for two complete algorithms. A new formulation of NS is presented, which casts the parameter space exploration as a search on a tree data structure. Previously published ways of obtaining robust error estimates and dynamic variations of the number of live points are presented as special cases of this formulation. A new online diagnostic test is presented based on previous insertion rank order work. The survey of nested sampling methods concludes with outlooks for future research.

arXiv commentPublished in Statistics Surveys. The open-source UltraNest package and astrostatistics tutorials can be found at https://johannesbuchner.github.io/UltraNest/

References in corpus (51)

• MultiNest: an efficient and robust Bayesian inference tool for cosmology and particle physics
• dynesty: A Dynamic Nested Sampling Package for Estimating Bayesian Posteriors and Evidences
• The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo
• Multimodal nested sampling: an efficient and robust alternative to MCMC methods for astronomical data analysis
• X-ray spectral modelling of the AGN obscuring region in the CDFS: Bayesian model selection and catalogue
• Importance Nested Sampling and the MultiNest Algorithm
• A Conceptual Introduction to Hamiltonian Monte Carlo
• PolyChord: nested sampling for cosmology
• PolyChord: next-generation nested sampling
• A Nested Sampling Algorithm for Cosmological Model Selection
• A General Framework for the Parametrization of Hierarchical Models
• Dynamic nested sampling: an improved algorithm for parameter estimation and evidence calculation
• Bayesian coherent analysis of in-spiral gravitational wave signals with a detector network
• A statistical test for Nested Sampling algorithms
• Collaborative Nested Sampling: Big Data vs. complex physical models
• Efficient Bayesian inference for multimodal problems in cosmology
• DIAMONDS: a new Bayesian Nested Sampling tool. Application to Peak Bagging of solar-like oscillations
• Properties of Nested Sampling
• Comparison of sampling techniques for Bayesian parameter estimation
• Determining pressure-temperature phase diagrams of materials
• Quantifying the Bayesian Evidence for a Planet in Radial Velocity Data
• Sampling Errors in Nested Sampling Parameter Estimation
• Modeling and Analysis Generic Interface for eXternal numerical codes (MAGIX)
• A simple prescription for simulating and characterizing gravitational arcs
• Assigning confidence to inspiral gravitational wave candidates with Bayesian model selection
• Recursive Pathways to Marginal Likelihood Estimation with Prior-Sensitivity Analysis
• nestcheck: diagnostic tests for nested sampling calculations
• Constant-pressure nested sampling with atomistic dynamics
• A Galaxy Model from 2MASS Star Counts in the Whole Sky Including the Plane
• Cruising The Simplex: Hamiltonian Monte Carlo and the Dirichlet Distribution
• BAMBI: blind accelerated multimodal Bayesian inference
• On statistical uncertainty in nested sampling
• Accelerated Bayesian inference using deep learning
• Bayesian data analysis tools for atomic physics
• Nested sampling cross-checks using order statistics
• Superposition Enhanced Nested Sampling
• Nested Sampling with Constrained Hamiltonian Monte Carlo
• Properties of the Affine Invariant Ensemble Sampler in high dimensions
• Mean shift cluster recognition method implementation in the nested sampling algorithm
• Nested sampling with plateaus
• The Nested_fit data analysis program
• Inference for Trans-dimensional Bayesian Models with Diffusive Nested Sampling
• Compromise-free Bayesian neural networks
• Computing Entropies With Nested Sampling
• A nested sampling code for targeted searches for continuous gravitational waves from pulsars
• JAXNS: a high-performance nested sampling package based on JAX
• Nested Sampling And Likelihood Plateaus
• Vertical-likelihood Monte Carlo
• Split Sampling: Expectations, Normalisation and Rare Events
• Entropy-Based Search Algorithm for Experimental Design
• Fitting and Comparison of Models of Radio Spectra

Cited by in corpus (45)

• The Need For Speed: Rapid Refitting Techniques for Bayesian Spectral Characterization of the Gravitational Wave Background Using PTAs
• Masses and radiative decay widths of S- and P-wave singly-, doubly- and triply-heavy charm and bottom baryons
• Importance nested sampling with normalising flows
• The NANOGrav 15-year Gravitational-Wave Background Methods
• The Radius of PSR J0740+6620 from NICER and XMM-Newton Data
• Search for Lorentz Invariance Violation from stacked Gamma-Ray Burst spectral lag data
• Decoding Neutron Star Observations: Revealing Composition through Bayesian Neural Networks
• Strong constraints on a simple self-interacting neutrino cosmology
• Bayesian model comparison for simulation-based inference
• Evidence for SiO cloud nucleation in the rogue planet PSO J318
• Genuine Retrieval of the AGN Host Stellar Population (GRAHSP)
• SRG/eROSITA No. 5: Discovery of quasi-periodic eruptions every ~3.7 days from a galaxy at z>0.1
• EP241021a: a months-duration X-ray transient with luminous optical and radio emission
• Scalable inference with Autoregressive Neural Ratio Estimation
• Cross-Comparison of Sampling Algorithms for Pulse Profile Modeling of PSR J0740+6620
• Anatomy of parameter-estimation biases in overlapping gravitational-wave signals
• Bayesian evidence estimation from posterior samples with normalizing flows
• X-ray diagnostics of Cassiopeia A's "Green Monster": evidence for dense shocked circumstellar plasma
• A comparison of Bayesian sampling algorithms for high-dimensional particle physics and cosmology applications
• The Radius of PSR J0437-4715 from NICER Data
• Long-lived multilevel coherences and spin-1 dynamics encoded in the rotational states of ultracold molecules
• AMOEBA: Automated Molecular Excitation Bayesian Line-Fitting Algorithm
• A catalogue of candidate milli-parsec separation massive black hole binaries from long term optical photometric monitoring
• A Bayesian inference and model selection algorithm with an optimisation scheme to infer the model noise power
• Validating Sequential Monte Carlo for Gravitational-Wave Inference
• Assessing the systematic errors of extreme-mass-ratio inspirals waveforms for testing general relativity
• Nested Sampling for Non-Gaussian Inference in SLAM Factor Graphs
• Fast and accurate parameter estimation of high-redshift sources with the Einstein Telescope
• Bayesian insights in Tycho supernova remnant : a detailed mapping of ejecta properties
• jaxspec : a fast and robust Python library for X-ray spectral fitting
• Modern Bayesian Sampling Methods for Cosmological Inference: A Comparative Study
• The eROSITA DR1 variability catalogue
• Kernel-, mean- and noise-marginalised Gaussian processes for exoplanet transits and $H_0$ inference
• Chandra Follow-up Observations of Swift-BAT-selected AGNs III
• Mechanical Sensors for Ultraheavy Dark Matter Searches via Long-range Forces
• Dynamical constraints on the vertical structure of Jupiter's polar cyclones
• A Bayesian approach to time-domain Photonic Doppler Velocimetry
• Inferring Evidence from Nested Sampling Data via Information Field Theory
• Exploring Synergies between Twinkle and Ariel: a Pilot Study
• Searching for unresolved massive black hole pairs through AGN photometric variability
• JWST high-contrast spectroscopy with speckle modelling: Atmospheric retrievals of the T dwarf companion HD 19467 B
• Background-level reconstruction of scalar-field potentials from dark-energy histories and comparison with analytic potential families
• Resonances in reflective Hamiltonian Monte Carlo
• Medium effects on light clusters from heavy-ion collisions within a relativistic mean-field description
• Inferring planet occurrence rates from radial velocities