KiDS-SBI: Simulation-based inference analysis of KiDS-1000 cosmic shear

Abstract

We present a simulation-based inference (SBI) cosmological analysis of cosmic shear two-point statistics from the fourth weak gravitational lensing data release of the ESO Kilo-Degree Survey (KiDS-1000). KiDS-SBI efficiently performs non-Limber projection of the matter power spectrum via Levin's method, and constructs log-normal random matter fields on the curved sky for arbitrary cosmologies, including effective prescriptions for intrinsic alignments and baryonic feedback. The forward model samples realistic galaxy positions and shapes based on the observational characteristics, incorporating shear measurement and redshift calibration uncertainties, as well as angular anisotropies due to variations in depth and point-spread function. To enable direct comparison with standard inference, we limit our analysis to pseudo-angular power spectra. The SBI is based on sequential neural likelihood estimation to infer the posterior distribution of spatially-flat $\Lambda$CDM cosmological parameters from 18,000 realisations. We infer a mean marginal of the growth of structure parameter $S_8\equiv {\sigma }_8({\Omega }_{\mathrm{m}}/0.3{)}^{0.5}=0.731\pm 0.033$ ($68\%$). We present a measure of goodness-of-fit for SBI and determine that the forward model fits the data well with a probability-to-exceed of $0.42$. For fixed cosmology, the learnt likelihood is approximately Gaussian, while constraints widen compared to a Gaussian likelihood analysis due to cosmology dependence in the covariance. Neglecting variable depth and anisotropies in the point spread function in the model can cause $S_8$ to be overestimated by $\sim 5\%$. Our results are in agreement with previous analysis of KiDS-1000 and reinforce a $2.9\sigma$ tension with constraints from cosmic microwave background measurements. This work highlights the importance of forward-modelling systematic effects in upcoming galaxy surveys.

arXiv comment41 pages, 30 figures. Published in Astronomy & Astrophysics

References in corpus (143)

• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• Array Programming with NumPy
• emcee: The MCMC Hammer
• HEALPix -- a Framework for High Resolution Discretization, and Fast Analysis of Data Distributed on the Sphere
• Efficient Computation of CMB anisotropies in closed FRW models
• First Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Preliminary Maps and Basic Results
• Binary companions of evolved stars in APOGEE DR14: Search method and catalog of ~5,000 companions
• MultiNest: an efficient and robust Bayesian inference tool for cosmology and particle physics
• The Complete Light-curve Sample of Spectroscopically Confirmed Type Ia Supernovae from Pan-STARRS1 and Cosmological Constraints from The Combined Pantheon Sample
• Weak Gravitational Lensing
• Dark Energy Survey Year 3 Results: Cosmological Constraints from Galaxy Clustering and Weak Lensing
• Bayesian photometric redshift estimation
• An All-Sky Analysis of Polarization in the Microwave Background
• KiDS-450: Cosmological parameter constraints from tomographic weak gravitational lensing
• Karhunen-Loeve eigenvalue problems in cosmology: how should we tackle large data sets?
• KiDS-1000 Cosmology: Cosmic shear constraints and comparison between two point statistics
• KiDS-1000 Cosmology: Multi-probe weak gravitational lensing and spectroscopic galaxy clustering constraints
• MASTER of the CMB Anisotropy Power Spectrum: A Fast Method for Statistical Analysis of Large and Complex CMB Data Sets
• CFHTLenS tomographic weak lensing cosmological parameter constraints: Mitigating the impact of intrinsic galaxy alignments
• Cosmology from cosmic shear power spectra with Subaru Hyper Suprime-Cam first-year data
• Cosmology with cosmic shear observations: a review
• CMB power spectrum parameter degeneracies in the era of precision cosmology
• The Shear TEsting Programme 1: Weak lensing analysis of simulated ground-based observations
• Dark energy constraints from cosmic shear power spectra: impact of intrinsic alignments on photometric redshift requirements
• Weak Lensing of the CMB: A Harmonic Approach
• Dark Energy Survey Year 3 Results: Cosmology from Cosmic Shear and Robustness to Data Calibration
• Bayesian Galaxy Shape Measurement for Weak Lensing Surveys - III. Application to the Canada-France-Hawaii Telescope Lensing Survey
• Intrinsic and Extrinsic Galaxy Alignment
• Extended Limber Approximation
• Gravitational Lensing Analysis of the Kilo Degree Survey
• An accurate halo model for fitting non-linear cosmological power spectra and baryonic feedback models
• A unified pseudo-$C_{\ell }$ framework
• Dark Energy Survey Year 3 Results: Cosmology from Cosmic Shear and Robustness to Modeling Uncertainty
• Weak lensing for precision cosmology
• Weak Lensing and Cosmology
• Third Data Release of the Hyper Suprime-Cam Subaru Strategic Program
• HMcode-2020: Improved modelling of non-linear cosmological power spectra with baryonic feedback
• The Skewness of the Aperture Mass Statistic
• The fourth data release of the Kilo-Degree Survey: ugri imaging and nine-band optical-IR photometry over 1000 square degrees
• CosmoSIS: modular cosmological parameter estimation
• GaBoDS: The Garching-Bonn Deep Survey; IV. Methods for the Image reduction of multi-chip Cameras
• Weighing the Giants IV: Cosmology and Neutrino Mass
• KiDS-450 + 2dFLenS: Cosmological parameter constraints from weak gravitational lensing tomography and overlapping redshift-space galaxy clustering
• Massive Lossless Data Compression and Multiple Parameter Estimation from Galaxy Spectra
• Accurate halo-model matter power spectra with dark energy, massive neutrinos and modified gravitational forces
• Likelihood Analysis of CMB Temperature and Polarization Power Spectra
• Bayesian Galaxy Shape Measurement for Weak Lensing Surveys -I. Methodology and a Fast Fitting Algorithm
• Constraints on intrinsic alignment contamination of weak lensing surveys using the MegaZ-LRG sample
• Measurement of intrinsic alignments in galaxy ellipticities
• The third data release of the Kilo-Degree Survey and associated data products
• Hyper Suprime-Cam Year 3 Results: Cosmology from Cosmic Shear Power Spectra
• A new method to quantify the effects of baryons on the matter power spectrum
• Dark Energy Survey Year 1 Results: Weak Lensing Shape Catalogues
• Quantifying baryon effects on the matter power spectrum and the weak lensing shear correlation
• Dark Energy Survey Year 3 Results: Weak Lensing Shape Catalogue
• A non-linear solution to the $S_8$ tension?
• Galaxy-galaxy weak lensing in SDSS: intrinsic alignments and shear calibration errors
• Improving lognormal models for cosmological fields
• KiDS-1000 catalogue: Redshift distributions and their calibration
• KiDS-1000 catalogue: Weak gravitational lensing shear measurements
• Massive optimal data compression and density estimation for scalable, likelihood-free inference in cosmology
• Weak lensing analysis in three dimensions
• Probability Distribution Function of Cosmological Density Fluctuations from Gaussian Initial Condition: Comparison of One- and Two-point Log-normal Model Predictions with N-body Simulations
• Weak gravitational lensing: reducing the contamination by intrinsic alignments
• Precision calculations of the cosmic shear power spectrum projection
• Tidal alignment of galaxies
• The impact of intrinsic alignment on current and future cosmic shear surveys
• Testing the tidal alignment model of galaxy intrinsic alignment
• KiDS-1000 Cosmology: constraints beyond flat $\Lambda$CDM
• KiDS-1000 Methodology: Modelling and inference for joint weak gravitational lensing and spectroscopic galaxy clustering analysis
• Likelihood-free inference with neural compression of DES SV weak lensing map statistics
• Photometric Redshift Calibration with Self Organising Maps
• KiDS+VIKING-450: A new combined optical & near-IR dataset for cosmology and astrophysics
• Nuisance hardened data compression for fast likelihood-free inference
• The SRG/eROSITA all-sky survey: Cosmology constraints from cluster abundances in the western Galactic hemisphere
• CMB temperature and polarisation pseudo-Cl estimators and covariances
• Suppressing the contribution of intrinsic galaxy alignments to the shear two-point correlation function
• Dependence of cosmic shear covariances on cosmology - Impact on parameter estimation
• Cosmic Shear Measurements with DES Science Verification Data
• Generalized massive optimal data compression
• Cosmic shear covariance: The log-normal approximation
• Evolution of cosmological dark matter perturbations
• Towards emulating cosmic shear data: Revisiting the calibration of the shear measurements for the Kilo-Degree Survey
• Joint constraints on cosmology and the impact of baryon feedback: combining KiDS-1000 lensing with the thermal Sunyaev-Zeldovich effect from Planck and ACT
• Estimating the large-scale angular power spectrum in the presence of systematics: a case study of Sloan Digital Sky Survey quasars
• Intrinsic Alignments of Galaxies in the Illustris Simulation
• Quantifying the global parameter tensions between ACT, SPT and Planck
• Bayesian optimisation for likelihood-free cosmological inference
• The effect of Limber and flat-sky approximations on galaxy weak lensing
• Testing the lognormality of the galaxy and weak lensing convergence distributions from Dark Energy Survey maps
• Shear Power Spectrum Reconstruction using Pseudo-Spectrum Method
• A new model to predict weak-lensing peak counts II. Parameter constraint strategies
• The Astro-WISE Optical Image Pipeline: Development and Implementation
• Dark Energy Survey Year 3 results: cosmology with moments of weak lensing mass maps -- validation on simulations
• KiDS-1000: cosmic shear with enhanced redshift calibration
• Cosmological Constraints from Galaxy Clusters and Groups in the eROSITA Final Equatorial Depth Survey
• Cosmic shear power spectra in practice
• Euclid Preparation. XXVIII. Forecasts for ten different higher-order weak lensing statistics
• On the insufficiency of arbitrarily precise covariance matrices: non-Gaussian weak lensing likelihoods
• Mock galaxy shape catalogs in the Subaru Hyper Suprime-Cam Survey
• A Full $w$CDM Analysis of KiDS-1000 Weak Lensing Maps using Deep Learning
• Constraining baryonic feedback and cosmology with weak-lensing, X-ray, and kinematic Sunyaev-Zeldovich observations
• Testing (modified) gravity with 3D and tomographic cosmic shear
• The skewed weak lensing likelihood: why biases arise, despite data and theory being sound
• Fourier analysis of multi-tracer cosmological surveys
• KiDS & Euclid: Cosmological implications of a pseudo angular power spectrum analysis of KiDS-1000 cosmic shear tomography
• A neural simulation-based inference approach for characterizing the Galactic Center $\gamma$-ray excess
• KiDS-1000: Cosmology with improved cosmic shear measurements
• Consistent cosmic shear in the face of systematics: a B-mode analysis of KiDS-450, DES-SV and CFHTLenS
• Cosmic Shear: Inference from Forward Models
• KiDS-1000: Constraints on the intrinsic alignment of luminous red galaxies
• The XXL survey: XLVI. Forward cosmological analysis of the C1 cluster sample
• The sum of the masses of the Milky Way and M31: a likelihood-free inference approach
• Unequal-Time Correlators for Cosmology
• A new model to predict weak-lensing peak counts III. Filtering technique comparisons
• Cosmological constraints from HSC survey first-year data using deep learning
• Libpsht - algorithms for efficient spherical harmonic transforms
• Fast Weak Lensing Simulations with Halo Model
• Robust Simulation-Based Inference in Cosmology with Bayesian Neural Networks
• Inhomogeneous systematic signals in cosmic shear observations
• The N5K Challenge: Non-Limber Integration for LSST Cosmology
• GLASS: Generator for Large Scale Structure
• Non-Gaussianity in the Weak Lensing Correlation Function Likelihood -- Implications for Cosmological Parameter Biases
• Bayesian weak lensing tomography: Reconstructing the 3D large-scale distribution of matter with a lognormal prior
• Constrained correlation functions
• Organised Randoms: Learning and correcting for systematic galaxy clustering patterns in KiDS using self-organising maps
• Bayesian model comparison for simulation-based inference
• Generalized shear-ratio tests: A new relation between cosmological distances, and a diagnostic for a redshift-dependent multiplicative bias in shear measurements
• The effects of varying depth in cosmic shear surveys
• Extreme data compression for the CMB
• Sufficiency of a Gaussian power spectrum likelihood for accurate cosmology from upcoming weak lensing surveys
• Fast and realistic large-scale structure from machine-learning-augmented random field simulations
• A simulation-based inference pipeline for cosmic shear with the Kilo-Degree Survey
• The cross-correlation between 3d cosmic shear and the integrated Sachs-Wolfe effect
• The unequal-time matter power spectrum: impact on weak lensing observables
• Almanac: Weak Lensing power spectra and map inference on the masked sphere
• Variations of cosmic large-scale structure covariance matrices across parameter space
• Propagating Residual Biases in Cosmic Shear Power Spectra
• 3D cosmic shear: numerical challenges, 3D lensing random fields generation and Minkowski Functionals for cosmological inference
• The Impact of Anisotropic Redshift Distributions on Angular Clustering
• Simulation-based inference of deep fields: galaxy population model and redshift distributions
• Fast likelihood-free inference in the LSS Stage IV era
• Measuring the thermal and ionization state of the low-$z$ IGM using likelihood free inference

Cited by in corpus (16)

• The CosmoVerse White Paper: Addressing observational tensions in cosmology with systematics and fundamental physics
• Simulation-Based Inference Benchmark for Weak Lensing Cosmology
• KiDS-Legacy: Covariance validation and the unified OneCovariance framework for projected large-scale structure observables
• Learning the Universe: Cosmological and Astrophysical Parameter Inference with Galaxy Luminosity Functions and Colours
• Hybrid summary statistics: neural weak lensing inference beyond the power spectrum
• XRISM constraints on the velocity power spectrum in the Coma cluster
• Cosmological Constraints with Void Lensing I: the Simulation-Based Inference Framework
• Galaxy cluster count cosmology with simulation-based inference
• Pixelization effects in cosmic shear angular power spectra
• Galaxy-Point Spread Function correlations as a probe of weak-lensing systematics with UNIONS data
• Constraining cosmological parameters using density split lensing and the conditional stellar mass function
• GalSBI: Phenomenological galaxy population model for cosmology using simulation-based inference
• Quantifying Weighted Morphological Content of Large-Scale Structures via Simulation-Based Inference
• How to embed any likelihood into SBI: Application to Planck + Stage IV galaxy surveys and Dynamical Dark Energy
• Exploring the Early Universe with Deep Learning
• $\text{SBi3PCF:}$ Simulation-based inference with the integrated 3PCF