Dynamic nested sampling: an improved algorithm for parameter estimation and evidence calculation

Abstract

We introduce dynamic nested sampling: a generalisation of the nested sampling algorithm in which the number of "live points" varies to allocate samples more efficiently. In empirical tests the new method significantly improves calculation accuracy compared to standard nested sampling with the same number of samples; this increase in accuracy is equivalent to speeding up the computation by factors of up to ~72 for parameter estimation and ~7 for evidence calculations. We also show that the accuracy of both parameter estimation and evidence calculations can be improved simultaneously. In addition, unlike in standard nested sampling, more accurate results can be obtained by continuing the calculation for longer. Popular standard nested sampling implementations can be easily adapted to perform dynamic nested sampling, and several dynamic nested sampling software packages are now publicly available.

14 pages + appendix, 16 figures. Added signal reconstruction numerical example using dyPolyChord. Moderate updates to text and appendices

References in corpus (11)

• Dark Energy Survey Year 1 Results: Cosmological Constraints from Galaxy Clustering and Weak Lensing
• PolyChord: nested sampling for cosmology
• PolyChord: next-generation nested sampling
• MOSFiT: Modular Open-Source Fitter for Transients
• Bayesian model selection without evidences: application to the dark energy equation-of-state
• fgivenx: A Python package for functional posterior plotting
• Sampling Errors in Nested Sampling Parameter Estimation
• nestcheck: diagnostic tests for nested sampling calculations
• Bayesian sparse reconstruction: a brute-force approach to astronomical imaging and machine learning
• Constraining the Stellar Mass Function from the Deficiency of Tidal Disruption Flares in the Nuclei of Massive Galaxies
• DNest4: Diffusive Nested Sampling in C++ and Python

Cited by in corpus (176)

• dynesty: A Dynamic Nested Sampling Package for Estimating Bayesian Posteriors and Evidences
• Stellar Population Inference with Prospector
• Juliet: a versatile modelling tool for transiting and non-transiting exoplanetary systems
• STRIDES: a 3.9 per cent measurement of the Hubble constant from the strong lens system DES J0408-5354
• 3-OGC: Catalog of gravitational waves from compact-binary mergers
• Six transiting planets and a chain of Laplace resonances in TOI-178
• TauREx III: A fast, dynamic and extendable framework for retrievals
• Nested sampling for physical scientists
• Life beyond 30: probing the -20<M_UV<-17 luminosity function at 8<z<13 with the NIRCam parallel field of the MIRI Deep Survey
• The Science Case for LIGO-India
• ARIADNE: Measuring accurate and precise stellar parameters through SED fitting
• Measuring the dark matter environments of black hole binaries with gravitational waves
• Nested Sampling Methods
• Occurrence rate of hot Jupiters around early-type M dwarfs based on TESS data
• Evidence for an intermediate-mass black hole from a gravitationally lensed gamma-ray burst
• Search for Axionlike-Particle-Induced Prompt Gamma-Ray Emission from Extragalactic Core-Collapse Supernovae with the Fermi Large Area Telescope
• The Return of the Templates: Revisiting the Galactic Center Excess with Multi-Messenger Observations
• Aurora: A Generalised Retrieval Framework for Exoplanetary Transmission Spectra
• Present-day mass-metallicity relation for galaxies using a new electron-temperature method
• A dynamical measure of the black hole mass in a quasar 11 billion years ago
• Dispersive Analysis of $B\to K^{(\ast )}$ and $B_s\to \varphi$ Form Factors
• Testing the Cosmological Principle with CatWISE Quasars: A Bayesian Analysis of the Number-Count Dipole
• Evolution of the Mass-Metallicity Relation from Redshift $z\approx 8$ to the Local Universe
• Towards inference of overlapping gravitational wave signals
• JWST transmission spectroscopy of HD 209458b: a super-solar metallicity, a very low C/O, and no evidence of CH4, HCN, or C2H2
• Fast and Credible Likelihood-Free Cosmology with Truncated Marginal Neural Ratio Estimation
• TOI-1452 b: SPIRou and TESS reveal a super-Earth in a temperate orbit transiting an M4 dwarf
• Simple-graduated dark energy and spatial curvature
• Measuring dark matter spikes around primordial black holes with Einstein Telescope and Cosmic Explorer
• Detection of the tidal deformation of WASP-103b at $3\sigma$ with CHEOPS
• The SAMI Galaxy Survey: stellar population and structural trends across the Fundamental Plane
• Spi-OPS: Spitzer and CHEOPS confirm the near-polar orbit of MASCARA-1 b and reveal a hint of dayside reflection
• A detailed analysis of the Gl 486 planetary system
• Importance nested sampling with normalising flows
• The GAPS Programme with HARPS-N at TNG. XXXVII. A precise density measurement of the young ultra-short period planet TOI-1807 b
• The Magellan-TESS Survey I: Survey Description and Mid-Survey Results
• Parametrized tests of post-Newtonian theory using principal component analysis
• TOI-530b: A giant planet transiting an M dwarf detected by TESS
• Caught in the Act: Core-powered Mass-loss Predictions for Observing Atmospheric Escape
• Constraints on warm dark matter from UV luminosity functions of high-z galaxies with Bayesian model comparison
• Performance forecasts for the primordial gravitational wave detection pipelines for AliCPT-1
• Toward the unambiguous identification of supermassive binary black holes through Bayesian inference
• The stellar populations of quiescent ultra-diffuse galaxies from optical to mid-infrared spectral energy distribution fitting
• Bayesian Inference of the Dense Matter Equation of State built upon Covariant Density Functionals
• Where intermediate-mass black holes could hide in the Galactic Centre: A full parameter study with the S2 orbit
• First semi-empirical test of the white dwarf mass-radius relationship using a single white dwarf via astrometric microlensing
• Betelgeuse fainter in the sub-millimetre too: an analysis of JCMT and APEX monitoring during the recent optical minimum
• The geometric albedo of the hot Jupiter HD 189733b measured with CHEOPS
• VARAHA: A Fast Non-Markovian sampler for estimating Gravitational-Wave posteriors
• Direct Constraints on the Extremely Metal-Poor Massive Stars Underlying Nebular C IV Emission from Ultra-Deep HST/COS Ultraviolet Spectroscopy
• GRB 200716C: Evidence for a Short Burst Being Lensed
• Towards a framework for testing general relativity with extreme-mass-ratio-inspiral observations
• Still at Odds with Conventional Galaxy Evolution: The Star Formation History of Ultra-Diffuse Galaxy Dragonfly 44
• An ALMA+ACA measurement of the shock in the Bullet Cluster
• Dark matter profiles of SPARC galaxies: a challenge to fuzzy dark matter
• Constraining spontaneous black hole scalarization in scalar-tensor-Gauss-Bonnet theories with current gravitational-wave data
• DESI Dark Energy Time Evolution is Recovered by Cosmologically Coupled Black Holes
• Ogle-2018-blg-0677lb: A super earth near the galactic bulge
• Planets larger than Neptune have elevated eccentricities
• The Hubble PanCET Program: A Metal-rich Atmosphere for the Inflated Hot Jupiter HAT-P-41b
• Fitting the light curves of Sagittarius A* with a hot-spot model
• Multimass modelling of Milky Way globular clusters -- I. Implications on their stellar initial mass function above 1 M${}_{\odot }$
• The cosmic build-up of dust and metals. Accurate abundances from GRB-selected star-forming galaxies at $1.7<z<6.3$
• Fast and robust Bayesian Inference using Gaussian Processes with GPry
• Exploring over 700 massive quiescent galaxies at z = 2-7: Demographics and stellar mass functions
• Evidence of wind signatures in the gas velocity profiles of Red Geysers
• Precision constraints on the neutron star equation of state with third-generation gravitational-wave observatories
• The Aemulus Project VI: Emulation of beyond-standard galaxy clustering statistics to improve cosmological constraints
• TESS discovery of a sub-Neptune orbiting a mid-M dwarf TOI-2136
• Stellar Populations in the Central 0.5 pc of Our Galaxy III: The Dynamical Sub-structures
• Probing the large scale structure using gravitational-wave observations of binary black holes
• Bayesian Model Selection with Future 21cm Observations of The Epoch of Reionisation
• A microlensing search of 700 million VVV light curves
• A candidate relativistic tidal disruption event at 340 Mpc
• Signatures of inflowing gas in red geyser galaxies hosting radio-AGN
• Does the speed of gravitational waves depend on the source velocity?
• A comprehensive revisit of select Galileo/NIMS observations of Europa
• Search for eccentric NSBH and BNS mergers in the third observing run of Advanced LIGO and Virgo
• Bayesian sparse reconstruction: a brute-force approach to astronomical imaging and machine learning
• VVV-WIT-08: the giant star that blinked
• Dark lenses through the dust: parallax microlensing events in the VVV
• Nested sampling with plateaus
• Toward a complete description of $b\to u{\ell }^{-}\bar{\nu }$ decays within the Weak Effective Theory
• New constraints on the central mass contents of Omega Centauri from combined stellar kinematics and pulsar timing
• GRB 220426A: A Thermal Radiation-Dominated Gamma-Ray Burst
• A dense mini-Neptune orbiting the bright young star HD 18599
• Bayesian evidence estimation from posterior samples with normalizing flows
• Optical polarization and spectral properties of the H-poor superluminous supernovae SN 2021bnw and SN 2021fpl
• The nascent milliquasar VT J154843.06+220812.6: tidal disruption event or extreme accretion-state change?
• Bayesian analysis of Juno/JIRAM's NIR observations of Europa
• A systematic validation of hot Neptunes in TESS data
• Uncovering the Invisible: A Study of Gaia18ajz, a Candidate Black Hole Revealed by Microlensing
• Post maximum light and late time optical imaging polarimetry of type I superluminous supernova 2020znr
• Allesfitter: Flexible Star and Exoplanet Inference From Photometry and Radial Velocity
• Constraining the Stellar Mass Function from the Deficiency of Tidal Disruption Flares in the Nuclei of Massive Galaxies
• A comparison of Bayesian sampling algorithms for high-dimensional particle physics and cosmology applications
• Bayesian fitting of multi-Gaussian expansion models to galaxy images
• Hiding in plain sight: observing planet-starspot crossings with the James Webb Space Telescope
• CHEOPS and TESS view of the ultra-short period super-Earth TOI-561 b
• Exploring phase space with Nested Sampling
• Planetary companions orbiting the M dwarfs GJ 724 and GJ 3988. A CARMENES and IRD collaboration
• A 16 Hour Transit of Kepler-167 e Observed by the Ground-based Unistellar Telescope Network
• Discriminating among cosmological models by data-driven methods
• Revisiting the HD 21749 Planetary System with Stellar Activity Modeling
• Realizing the potential of deep neural network for analyzing neutron star observables and dense matter equation of state
• Uniform Modelling of the Stellar Density of Thirteen Tidal Streams within the Galactic Halo
• GalaPy, the highly optimised C++/Python spectral modelling tool for galaxies -- I. Library presentation and photometric fitting
• Mapping the Skies of Ultracool Worlds: Detecting Storms and Spots with Extremely Large Telescopes
• Detecting Baryon Acoustic Oscillations with third generation gravitational wave observatories
• BASS XLVII: 22 GHz Radio Atlas of Swift-BAT Selected AGN
• Constraining $|V_{cs}|$ and physics beyond the Standard Model from exclusive (semi)leptonic charm decays
• HD 183579b: A Warm Sub-Neptune Transiting a Solar Twin Detected by TESS
• Impact of higher harmonics of gravitational radiation on the population inference of binary black holes
• Dark skies of the slightly eccentric WASP-18 b from its optical-to-infrared dayside emission
• The Frequency and Mass-Ratio Distribution of Binaries in Clusters I: Description of the method and application to M67
• The proper motion of stars in dwarf galaxies: distinguishing central density cusps from cores
• Differential Interferometric Signatures of Close Binaries of Supermassive Black Holes in Active Galactic Nuclei: II. Merged Broad Line Regions
• Flow Matching for Atmospheric Retrieval of Exoplanets: Where Reliability meets Adaptive Noise Levels
• Accelerating Tests of General Relativity with Gravitational-Wave Signals using Hybrid Sampling
• TIC~257060897b: an inflated, low-density, hot-Jupiter transiting a rapidly evolving subgiant star
• Exploiting the transit timing capabilities of Ariel
• SN 2019odp: A Massive Oxygen-Rich Type Ib Supernova
• RadioSED I: Bayesian inference of radio SEDs from inhomogeneous surveys
• Constraints on Bianchi-I type universe with SH0ES anchored Pantheon+ SNIa data
• Low-Frequency Turnover Star Forming Galaxies I: Radio Continuum Observations and Global Properties
• NGTS-21b: An Inflated Super-Jupiter Orbiting a Metal-poor K dwarf
• Two neighbours of the ultra-short-period Earth-sized planet K2-157 b in the warm Neptunian savanna
• Fast and accurate parameter estimation of high-redshift sources with the Einstein Telescope
• The GAPS Programme at TNG. LXV. Precise density measurement of TOI-1430 b, a young planet with an evaporating atmosphere
• Fast and faithful interpolation of numerical relativity surrogate waveforms using meshfree approximation
• The SPACE Program. I. The featureless spectrum of HD 86226 c challenges sub-Neptune atmosphere trends
• A probabilistic approach to phase calibration: I. Effects of source structure on fringe-fitting
• The soft X-ray transient EP241021a: A cosmic explosion with a complex off-axis jet and cocoon from a massive progenitor
• Modeling Star Formation Histories of Changing-Look AGN Host Galaxies with Prospector
• A Stringent Upper Limit on Dark Matter Self-Interaction Cross Section from Cluster Strong Lensing
• Detectability of Gravitational-Wave Memory with LISA: A Bayesian Approach
• GRB 201104A: A "Repetitive" Short Gamma-Ray Burst?
• Population synthesis and parameter estimation of neutron stars with continuous gravitational waves and third-generation detectors
• Nested Sampling And Likelihood Plateaus
• Tidally Heated Sub-Neptunes, Refined Planetary Compositions, and Confirmation of a Third Planet in the TOI-1266 System
• Kernel-, mean- and noise-marginalised Gaussian processes for exoplanet transits and $H_0$ inference
• Gravitational-wave model for neutron star merger remnants with supervised learning
• Impact on $L$-observables of a new combined analysis of $B_{d,s}\to K^{(\ast )}$ form factors
• Evidence for a Nonzero Eccentricity Superpuff Exoplanet WASP-107 b Using JWST Occultation Observation
• A Moderate Albedo from Reflecting Aerosols on the Dayside of WASP-80 b Revealed by JWST/NIRISS Eclipse Spectroscopy
• Precise radial velocities of giant stars -- XVII. Distinguishing planets from intrinsically induced radial velocity signals in evolved stars
• Arbitrary Marginal Neural Ratio Estimation for Simulation-based Inference
• AGN in the ULIRG HE 0435-5304
• RedDots: Planetary masses in the GJ1061 system from planet-planet interaction
• A practical Bayesian method for gravitational-wave ringdown analysis with multiple modes
• Search for giant planets in M67 V: a warm Jupiter orbiting the turn-off star S1429
• Inferring Evidence from Nested Sampling Data via Information Field Theory
• Improved Identification of Strongly Lensed Gravitational Waves with Host Galaxy Locations
• TESS phase curve of ultra-hot Jupiter WASP-189 b
• Closing the Evidence Gap: reddemcee, a Fast Adaptive Parallel Tempering Sampler
• Optical ray tracing of echelle spectrographs applied to the wavelength solution for precise radial velocities
• Bayesian Analysis of the ${}^{86}$Sr$(\alpha ,\alpha )$ Reaction to Constrain the ${}^{86}$Sr$(\alpha ,n)$ Cross Section at Astrophysical Energies
• The dark and featureless surface of rocky exoplanet LHS 3844 b from JWST mid-infrared spectroscopy
• Statistical biases in parametrized searches for gravitational-wave polarizations
• Mapping the 3D Kinematical Structure of the Gas Disk of HD 169142
• The Progenitor Systems of Classical Novae in M31
• Probing the disk-jet coupling in M87
• Inferring planet occurrence rates from radial velocities
• Towards a Field Based Bayesian Evidence Inference from Nested Sampling Data
• TOI-333b: A Neptune Desert planet around a F7V star
• Dynamical analysis of the 5:1 mean-motion resonance of the HD 202206 system
• Bayesian vs Frequentist: Comparing Bayesian model selection with a frequentist approach using the iterative smoothing method
• MINDS survey of silicates in T Tauri disks: Correlation between dust and gas
• Short gamma-ray burst progenitors have short delay times
• Constraining the population of dark matter halo shapes using hierarchical inference with extragalactic stellar streams
• Black-box density function estimation using recursive partitioning
• Inferring binary black holes stellar progenitors with gravitational wave sources
• Global Determination of $|V_{us}|$
• Non-parametric and continuous extraction of amplitudes in electroweak penguin decays
• Two Rings and a Marginally Resolved, 5 AU, Disk Around LkCa 15 Identified Via Near Infrared Sparse Aperture Masking Interferometry
• Revisiting the secondary eclipses of KELT-1b using TESS observations