APES: Approximate Posterior Ensemble Sampler
arXiv:2303.13667 · doi:10.1093/mnras/stad2245
Abstract
This paper proposes a novel approach to generate samples from target distributions that are difficult to sample from using Markov Chain Monte Carlo (MCMC) methods. Traditional MCMC algorithms often face slow convergence due to the difficulty in finding proposals that suit the problem at hand. To address this issue, the paper introduces the Approximate Posterior Ensemble Sampler (APES) algorithm, which employs kernel density estimation and radial basis interpolation to create an adaptive proposal, leading to fast convergence of the chains. The APES algorithm's scalability to higher dimensions makes it a practical solution for complex problems. The proposed method generates an approximate posterior probability that closely approximates the desired distribution and is easy to sample from, resulting in smaller autocorrelation times and a higher probability of acceptance by the chain. We compare the performance of the APES algorithm with the affine invariance ensemble sampler with the stretch move in various contexts, demonstrating the efficiency of the proposed method. For instance, on the Rosenbrock function, the APES presented an autocorrelation time 140 times smaller than the affine invariance ensemble sampler. The comparison showcases the effectiveness of the APES algorithm in generating samples from challenging distributions. This paper presents a practical solution to generating samples from complex distributions while addressing the challenge of finding suitable proposals. With new cosmological surveys set to deal with many new systematics, this method offers a practical solution for the upcoming era of cosmological analyses. The algorithms presented in this paper are available at https://github.com/NumCosmo/NumCosmo.
arXiv comment18 pages, 8 figures, 7 tables
References in corpus (32)
- emcee: The MCMC Hammer
- Efficient Computation of CMB anisotropies in closed FRW models
- Cosmological parameters from CMB and other data: a Monte-Carlo approach
- The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: cosmological analysis of the DR12 galaxy sample
- MultiNest: an efficient and robust Bayesian inference tool for cosmology and particle physics
- dynesty: A Dynamic Nested Sampling Package for Estimating Bayesian Posteriors and Evidences
- The Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: Cosmological Implications from two Decades of Spectroscopic Surveys at the Apache Point observatory
- The Pantheon+ Analysis: Cosmological Constraints
- Bayes in the sky: Bayesian inference and model selection in cosmology
- The Pantheon+ Analysis: The Full Dataset and Light-Curve Release
- Conservative Constraints on Early Cosmology: an illustration of the Monte Python cosmological parameter inference code
- Efficient sampling of fast and slow cosmological parameters
- PolyChord: nested sampling for cosmology
- Dynamic temperature selection for parallel-tempering in Markov chain Monte Carlo simulations
- CosmoSIS: modular cosmological parameter estimation
- Fast and reliable MCMC for cosmological parameter estimation
- A Large Catalog of Accurate Distances to Local Molecular Clouds: The Gaia DR2 Edition
- 21CMMC: an MCMC analysis tool enabling astrophysical parameter studies of the cosmic 21 cm signal
- An Older, More Quiescent Universe from Panchromatic SED Fitting of the 3D-HST Survey
- The Normal Law Under Linear Restrictions: Simulation and Estimation via Minimax Tilting
- II: Bayesian Methods for Cosmological Parameter Estimation from Cosmic Microwave Background Measurements
- CosmoHammer: Cosmological parameter estimation with the MCMC Hammer
- Bilby-MCMC: An MCMC sampler for gravitational-wave inference
- zeus: A Python implementation of Ensemble Slice Sampling for efficient Bayesian parameter inference
- An MCMC approach to extracting the global 21-cm signal during the cosmic dawn from sky-averaged radio observations
- Rapid Calculation of Theoretical CMB Angular Power Spectra
- Cosmological constraints from a joint analysis of cosmic microwave background and spectroscopic tracers of the large-scale structure
- CMBfit: Rapid WMAP likelihood calculations with normal parameters
- Nested sampling with any prior you like
- Solving high-dimensional parameter inference: marginal posterior densities & Moment Networks
- SCoPE: An efficient method of Cosmological Parameter Estimation
- MCMC determination of the cosmic UV background at from H fluorescence