A statistical test for Nested Sampling algorithms

Abstract

Nested sampling is an iterative integration procedure that shrinks the prior volume towards higher likelihoods by removing a "live" point at a time. A replacement point is drawn uniformly from the prior above an ever-increasing likelihood threshold. Thus, the problem of drawing from a space above a certain likelihood value arises naturally in nested sampling, making algorithms that solve this problem a key ingredient to the nested sampling framework. If the drawn points are distributed uniformly, the removal of a point shrinks the volume in a well-understood way, and the integration of nested sampling is unbiased. In this work, I develop a statistical test to check whether this is the case. This "Shrinkage Test" is useful to verify nested sampling algorithms in a controlled environment. I apply the shrinkage test to a test-problem, and show that some existing algorithms fail to pass it due to over-optimisation. I then demonstrate that a simple algorithm can be constructed which is robust against this type of problem. This RADFRIENDS algorithm is, however, inefficient in comparison to MULTINEST.

11 pages, 7 figures. Published in Statistics and Computing, Springer, September 2014

References in corpus (6)

• MultiNest: an efficient and robust Bayesian inference tool for cosmology and particle physics
• Multimodal nested sampling: an efficient and robust alternative to MCMC methods for astronomical data analysis
• A Nested Sampling Algorithm for Cosmological Model Selection
• Properties of Nested Sampling
• Recursive Pathways to Marginal Likelihood Estimation with Prior-Sensitivity Analysis
• Nested Sampling with Constrained Hamiltonian Monte Carlo

Cited by in corpus (135)

• dynesty: A Dynamic Nested Sampling Package for Estimating Bayesian Posteriors and Evidences
• Bayesian inference for compact binary coalescences with BILBY: Validation and application to the first LIGO--Virgo gravitational-wave transient catalogue
• The SRG/eROSITA all-sky survey: First X-ray catalogues and data release of the western Galactic hemisphere
• Collaborative Nested Sampling: Big Data vs. complex physical models
• Six transiting planets and a chain of Laplace resonances in TOI-178
• The Art of Measuring Physical Parameters in Galaxies: A Critical Assessment of Spectral Energy Distribution Fitting Techniques
• Nested sampling for physical scientists
• ARIADNE: Measuring accurate and precise stellar parameters through SED fitting
• Nested Sampling Methods
• The eROSITA Final Equatorial-Depth Survey (eFEDS): The AGN Catalogue and its X-ray Spectral Properties
• Parameter estimation with gravitational waves
• A new measurement of the expansion history of the Universe at z=1.26 with cosmic chronometers in VANDELS
• Distribution of solids in the rings of the HD 163296 disk: a multiwavelength study
• Information Content Analysis for Selection of Optimal JWST Observing Modes for Transiting Exoplanet Atmospheres
• Quantifying the Bayesian Evidence for a Planet in Radial Velocity Data
• nestcheck: diagnostic tests for nested sampling calculations
• The GAPS Programme with HARPS-N at TNG. XXXVII. A precise density measurement of the young ultra-short period planet TOI-1807 b
• $\mathtt{bajes}$: Bayesian inference of multimessenger astrophysical data, methods and application to gravitational-waves
• Mass determinations of the three mini-Neptunes transiting TOI-125
• AT 2019avd: A novel addition to the diverse population of nuclear transients
• Tracing Interstellar Heating: An ALCHEMI Measurement of the HCN Isomers in NGC 253
• APPLESOSS: A Producer of ProfiLEs for SOSS. Application to the NIRISS SOSS Mode
• The ESO SupJup Survey I: Chemical and isotopic characterisation of the late L-dwarf DENIS J0255-4700 with CRIRES${}^{+}$
• Exploring the likelihood of the 21-cm power spectrum with simulation-based inference
• Star-forming early- and quiescent late-type galaxies in the local Universe
• 21cmEMU: an emulator of 21cmFAST summary observables
• The Giant Accreting Protoplanet Survey (GAPlanetS) -- Results from a Six Year Campaign to Image Accreting Protoplanets
• Toward Robust Corrections for Stellar Contamination in JWST Exoplanet Transmission Spectra
• The Radius of PSR J0740+6620 from NICER and XMM-Newton Data
• An Atmospheric Retrieval of the Brown Dwarf Gliese 229B
• Characterizing the protolunar disk of the accreting companion GQ Lupi B
• Ground-Based Transmission Spectroscopy with FORS2: A featureless optical transmission spectrum and detection of H${}_2$O for the ultra-hot Jupiter WASP-103b
• Bayesian data analysis tools for atomic physics
• TOI-1231 b: A Temperate, Neptune-Sized Planet Transiting the Nearby M3 Dwarf NLTT 24399
• Indications for very high metallicity and absence of methane for the eccentric exo-Saturn WASP-117b
• The mass function dependence on the dynamical state of dark matter haloes
• Large Exomoons unlikely around Kepler-1625 b and Kepler-1708 b
• Nested sampling cross-checks using order statistics
• Fitting the light curves of Sagittarius A* with a hot-spot model
• Dalek -- a deep-learning emulator for TARDIS
• AGN X-ray luminosity function and absorption function in the Early Universe ($3\le z\le 6$)
• A kinematic study of central compact objects and their host supernova remnants
• JWST COMPASS: NIRSpec/G395H Transmission Observations of the Super-Earth TOI-776b
• Constraints on quantum gravity and the photon mass from gamma ray bursts
• Revisiting Radial Velocity Measurements of the K2-18 System with the Line-by-Line Framework
• Star formation and molecular gas properties of post-starburst galaxies
• Optical polarization from colliding stellar stream shocks in a tidal disruption event
• SRG/eROSITA No. 5: Discovery of quasi-periodic eruptions every ~3.7 days from a galaxy at z>0.1
• BAYES-LOSVD: a bayesian framework for non-parametric extraction of the line-of-sight velocity distribution of galaxies
• Orbital decay in an accreting and eclipsing 13.7 minute orbital period binary with a luminous donor
• No Surviving SN Ia Companion In SNR 0509-67.5: Stellar Population Characterization and Comparison To Models
• Physical Parameters and Properties of 20 Cold Brown Dwarfs in JWST
• MUSEQuBES: The relation between Ly$\alpha$ emitters and C IV absorbers at $z\approx 3.3$
• Reconstructing the shock history in the CMZ of NGC 253 with ALCHEMI
• Bayesian inference of the dense matter equation of state built upon extended Skyrme interactions
• Family dispute: do Type IIP supernova siblings agree on their distance?
• Mean shift cluster recognition method implementation in the nested sampling algorithm
• Hierarchical Bayesian method for detecting continuous gravitational waves from an ensemble of pulsars
• Stability and detectability of exomoons orbiting HIP 41378 f, a temperate Jovian planet with an anomalously low apparent density
• Wide-Band Spectral Variability of Peaked Spectrum Sources
• Cross-Comparison of Sampling Algorithms for Pulse Profile Modeling of PSR J0740+6620
• Bayesian Inference of dense matter equation of state of neutron star with antikaon condensation
• Reeling in the Whirlpool: the distance to M 51 clarified by Cepheids and the Type IIP SN 2005cs
• Anatomy of parameter-estimation biases in overlapping gravitational-wave signals
• Systematic evaluation of variability detection methods for eROSITA
• Probabilistic Reconstruction of Type Ia Supernova SN 2002bo
• The eROSITA Final Equatorial-Depth Survey (eFEDS): The first archetypal Quasar in the feedback phase discovered by eROSITA
• Bump-hunting in the diffuse flux of high-energy cosmic neutrinos
• Binary properties of the globular cluster 47 Tuc (NGC 104). A dearth of short-period binaries
• Radio Burst from a Stellar Coronal Mass Ejection
• The SRG/eROSITA all-sky survey. X-ray emission from the warm-hot phase gas in long cosmic filaments
• A comparison of Bayesian sampling algorithms for high-dimensional particle physics and cosmology applications
• JWST-TST DREAMS: Non-Uniform Dayside Emission for WASP-17b from MIRI/LRS
• The eROSITA Final Equatorial Depth Survey (eFEDS): the hard X-ray selected sample
• The relation between accretion rate and jet power in early-type galaxies with thermally unstable hot atmospheres
• Grid-Based Atmospheric Retrievals for Reflected-Light Spectra of Exoplanets using PSGnest
• The connection between stellar mass, age and quenching timescale in massive quiescent galaxies at $z\simeq 1$
• Very-High-Energy Gamma-Ray Afterglows of GRB 201015A and GRB 201216C
• Unravelling sub-stellar magnetospheres
• Comparison of Step Samplers for Nested Sampling
• An accreting dwarf star orbiting the S-type giant star pi1 Gru
• Disentangling the dust and gas contributions of the JWST/MIRI spectrum of Sz28
• Hyenas: X-ray Bubbles and Cavities in the Intra-Group Medium
• A Population Analysis of 20 Exoplanets Observed from the Optical to the Near-infrared Wavelengths with HST: Evidence for Widespread Stellar Contamination
• Observational Evidence of a Centi-parsec Supermassive Black Hole Binary Existing in the Nearby Galaxy M81
• The ESO SupJup Survey VIII. Chemical fingerprints of young L dwarf twins
• The Radius of PSR J0437-4715 from NICER Data
• First upper limits on the 21-cm signal power spectrum of neutral hydrogen at $z=9.16$ from the LOFAR 3C196 field
• A catalogue of candidate milli-parsec separation massive black hole binaries from long term optical photometric monitoring
• Constraints on non-unitary neutrino mixing in light of atmospheric and reactor neutrino data
• Molecular isotopologue measurements toward super star clusters and the relation to their ages in NGC253 with ALCHEMI
• Cosmic dipole tensions: confronting the cosmic microwave background with infrared and radio populations of cosmological sources
• Revealing Dark Matter's Role in Neutron Stars Anisotropy: A Bayesian Approach Using Multi-messenger Observations
• Characterising X-ray variability in light curves with complex sampling patterns: application to the eROSITA south ecliptic pole survey
• A hard look at the X-ray spectral variability of NGC 7582
• Exploring $\Delta$-resonance in neutron stars: implications from astrophysical and nuclear observations
• Learning the Composition of Ultra High Energy Cosmic Rays
• HIP 15429: A newborn Be star on an eccentric binary orbit
• Bias-Free Estimation of Signals on Top of Unknown Backgrounds
• A multi-scale investigation into the diagnostic potential of the HCN/HCO${}^{+}$ ratio for AGN and starburst activity in nearby galaxies
• The GAPS Programme at TNG. LXV. Precise density measurement of TOI-1430 b, a young planet with an evaporating atmosphere
• Gaussian Processes and Nested Sampling Applied to Kepler's Small Long-period Exoplanet Candidates
• Cross-correlation between soft X-rays and galaxies A new benchmark for galaxy evolution models
• Universality of the halo mass function in screened gravity theories
• The Dynamic Inner Disk of a Planet Forming Star
• Globular clusters as cosmic clocks: new cosmological hints from their integrated light
• Modelling the selection of galaxy groups with end to end simulations
• Revisiting the X-ray-to-UV relation of Quasars in the era of all-sky surveys
• Testing the dark origin of neutrino masses with oscillation experiments
• The eROSITA DR1 variability catalogue
• Robust parameter estimation from pulsar timing data
• Identifying the most constraining ice observations to infer molecular binding energies
• Double-peaked Ca II traces a relativistic broad-line region disk in NGC 4593
• HOLISMOKES -- XIV. Time-delay and differential dust extinction determination with lensed type II supernova color curves
• Flares in the Changing Look AGN Mrk 590. II: Deep X-ray observations reveal a Comptonizing inner accretion flow
• The density profile of Milky Way dark matter halo constrained from the OGLE microlensing sky map
• Ultraviolet spectroscopy reveals a hot and luminous companion to the Be star+black hole candidate MWC 656
• Testing general relativity with gravitational waves -- improving and extending Modified Dispersion Relation tests
• Relating spatially resolved optical attenuation, dust and gas in nearby galaxies
• Spectral analysis of two directly imaged benchmark L dwarf companions at the stellar-substellar boundary
• Survey of Orion Disks with ALMA (SODA) III: Disks in wide binary systems in L1641 and L1647
• Kinematic Lensing Inference II: Cluster Lensing with $\mathcal{O}$(1) Galaxies
• KRONOS I: The $1-2.8\mu$m JWST Transmission Spectrum of the 23 Myr V1298 Tau c
• Growing in number, passive in nature: tracing the evolution of the most massive quiescent galaxies since z ~ 0.8 with BOSS and DESI
• X-ray analysis of the Planck-detected triplet-cluster system PLCK G334.8-38
• A Low Metallicity Massive Contact Binary Star System Candidate in WLM identified by Hubble and James Webb Space Telescope imaging
• No Flavor Anisotropy in the High-Energy Neutrino Sky Upholds Lorentz Invariance
• An Order Statistics Post-Mortem on LIGO-Virgo GWTC-2 Events Analysed with Nested Sampling
• Panchromatic View of the Frigid Jovian Exoplanet COCONUTS-2 b
• Background-level reconstruction of scalar-field potentials from dark-energy histories and comparison with analytic potential families
• The Halo21 Absorption Modeling Challenge: Lessons From "Observing" Synthetic Circumgalactic Absorption Spectra
• Constraining Quintessence Models with ISW-tSZ Cross-Correlations: A Comparative Analysis of Thawing, Tracker, and Scaling-Freezing Dynamics
• Cosmic chronometers with galaxy clusters: a new avenue for multi-probe cosmology
• New mass estimates for massive binary systems: a probabilistic approach using polarimetric radiative transfer
• The Ellis and Baldwin test of the Cosmic Dipole: Exploring the impact of multiple flux density cuts