KiDS-1000 Methodology: Modelling and inference for joint weak gravitational lensing and spectroscopic galaxy clustering analysis

Abstract

We present the methodology for a joint cosmological analysis of weak gravitational lensing from the fourth data release of the ESO Kilo-Degree Survey (KiDS-1000) and galaxy clustering from the partially overlapping BOSS and 2dFLenS surveys. Cross-correlations between galaxy positions and ellipticities have been incorporated into the analysis, necessitating a hybrid model of non-linear scales that blends perturbative and non-perturbative approaches, and an assessment of contributions by astrophysical effects. All weak lensing signals are measured consistently via Fourier-space statistics that are insensitive to the survey mask and display low levels of mode mixing. The calibration of photometric redshift distributions and multiplicative gravitational shear bias has been updated, and a more complete tally of residual calibration uncertainties is propagated into the likelihood. A dedicated suite of more than 20000 mocks is used to assess the performance of covariance models and to quantify the impact of survey geometry and spatial variations of survey depth on signals and their errors. The sampling distributions for the likelihood and the ${\chi }^2$ goodness-of-fit statistic have been validated, with proposed changes to the number of degrees of freedom. Standard weak lensing point estimates on $S_8={\sigma }_8({\Omega }_{\mathrm{m}}/0.3{)}^{1/2}$ derived from its marginal posterior are easily misinterpreted to be biased low, and an alternative estimator and associated credible interval have been proposed. Known systematic effects pertaining to weak lensing modelling and inference are shown to bias $S_8$ by no more than 0.1 standard deviations, with the caveat that no conclusive validation data exist for models of intrinsic galaxy alignments. Compared to the previous KiDS analyses, $S_8$ constraints are expected to improve by 20% for weak lensing alone and by 29% for the joint analysis. [abridged]

arXiv comment45 pages, 34 figures, 7 tables; minor changes to match version accepted by A&A. The KiDS-1000 data products are available for download at http://kids.strw.leidenuniv.nl/DR4/lensing.php. This data release includes open source software, the shear-photo-z catalogue, the cosmic shear and 3x2pt data vectors and covariances, and posteriors in the form of Multinest chains

References in corpus (161)

• The Structure of Cold Dark Matter Halos
• HEALPix -- a Framework for High Resolution Discretization, and Fast Analysis of Data Distributed on the Sphere
• Efficient Computation of CMB anisotropies in closed FRW models
• Cosmological parameters from CMB and other data: a Monte-Carlo approach
• The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: cosmological analysis of the DR12 galaxy sample
• MultiNest: an efficient and robust Bayesian inference tool for cosmology and particle physics
• The Complete Light-curve Sample of Spectroscopically Confirmed Type Ia Supernovae from Pan-STARRS1 and Cosmological Constraints from The Combined Pantheon Sample
• The Eleventh and Twelfth Data Releases of the Sloan Digital Sky Survey: Final Data from SDSS-III
• Weak Gravitational Lensing
• SDSS-III: Massive Spectroscopic Surveys of the Distant Universe, the Milky Way Galaxy, and Extra-Solar Planetary Systems
• Stable clustering, the halo model and nonlinear cosmological power spectra
• Multimodal nested sampling: an efficient and robust alternative to MCMC methods for astronomical data analysis
• Dark Energy Survey Year 1 Results: Cosmological Constraints from Galaxy Clustering and Weak Lensing
• Tensions between the Early and the Late Universe
• Bayesian photometric redshift estimation
• Revising the Halofit Model for the Nonlinear Matter Power Spectrum
• Planck 2018 results. V. CMB power spectra and likelihoods
• KiDS-450: Cosmological parameter constraints from tomographic weak gravitational lensing
• The Large Scale Bias of Dark Matter Halos: Numerical Calibration and Model Tests
• Importance Nested Sampling and the MultiNest Algorithm
• Dark matter halo concentrations in the Wilkinson Microwave Anisotropy Probe year 5 cosmology
• Power Spectrum Analysis of Three-Dimensional Redshift Surveys
• Why your model parameter confidences might be too optimistic -- unbiased estimation of the inverse covariance matrix
• Large-Scale Galaxy Bias
• KiDS-1000 Cosmology: Cosmic shear constraints and comparison between two point statistics
• KiDS-1000 Cosmology: Multi-probe weak gravitational lensing and spectroscopic galaxy clustering constraints
• CFHTLenS: The Canada-France-Hawaii Telescope Lensing Survey
• Extragalactic Science, Cosmology and Galactic Archaeology with the Subaru Prime Focus Spectrograph (PFS)
• How Many Galaxies Fit in a Halo? Constraints on Galaxy Formation Efficiency from Spatial Clustering
• Dark Energy Survey Year 1 Results: Cosmological Constraints from Cosmic Shear
• CFHTLenS tomographic weak lensing cosmological parameter constraints: Mitigating the impact of intrinsic galaxy alignments
• Intrinsic alignment-lensing interference as a contaminant of cosmic shear
• Redshift-Space Distortions, Pairwise Velocities and Nonlinearities
• Renormalized Cosmological Perturbation Theory
• Cosmology from cosmic shear power spectra with Subaru Hyper Suprime-Cam first-year data
• CMB power spectrum parameter degeneracies in the era of precision cosmology
• The WiggleZ Dark Energy Survey: the growth rate of cosmic structure since redshift z=0.9
• Dark energy constraints from cosmic shear power spectra: impact of intrinsic alignments on photometric redshift requirements
• The Cosmological Analysis of the SDSS/BOSS data from the Effective Field Theory of Large-Scale Structure
• Bayesian Galaxy Shape Measurement for Weak Lensing Surveys - III. Application to the Canada-France-Hawaii Telescope Lensing Survey
• Extended Limber Approximation
• Cosmological Parameters from the BOSS Galaxy Power Spectrum
• Gravitational Lensing Analysis of the Kilo Degree Survey
• An accurate halo model for fitting non-linear cosmological power spectra and baryonic feedback models
• A new measure for cosmic shear
• Weak lensing for precision cosmology
• Cosmological parameters from lensing power spectrum and bispectrum tomography
• Stochastic Nonlinear Galaxy Biasing
• KiDS+VIKING-450: Cosmic shear tomography with optical+infrared data
• The Skewness of the Aperture Mass Statistic
• The clustering of galaxies in the SDSS-III Baryon Oscillation Spectroscopic Survey: mock galaxy catalogues for the BOSS Final Data Release
• The fourth data release of the Kilo-Degree Survey: ugri imaging and nine-band optical-IR photometry over 1000 square degrees
• Systematic errors in weak lensing: application to SDSS galaxy-galaxy weak lensing
• CosmoSIS: modular cosmological parameter estimation
• GaBoDS: The Garching-Bonn Deep Survey; IV. Methods for the Image reduction of multi-chip Cameras
• Gravity and Large-Scale Non-local Bias
• KiDS-450 + 2dFLenS: Cosmological parameter constraints from weak gravitational lensing tomography and overlapping redshift-space galaxy clustering
• Power Spectrum Super-Sample Covariance
• The clustering of massive galaxies at z~0.5 from the first semester of BOSS data
• The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: Observational systematics and baryon acoustic oscillations in the correlation function
• CosmoLike - Cosmological Likelihood Analyses for Photometric Galaxy Surveys
• Practical Weak Lensing Shear Measurement with Metacalibration
• The Clustering of Galaxies in the SDSS-III Baryon Oscillation Spectroscopic Survey: Including covariance matrix errors
• Likelihood Analysis of CMB Temperature and Polarization Power Spectra
• Bayesian Galaxy Shape Measurement for Weak Lensing Surveys -I. Methodology and a Fast Fitting Algorithm
• KiDS+GAMA: Cosmology constraints from a joint analysis of cosmic shear, galaxy-galaxy lensing and angular clustering
• B-modes in cosmic shear from source redshift clustering
• Constraints on intrinsic alignment contamination of weak lensing surveys using the MegaZ-LRG sample
• The Coyote Universe Extended: Precision Emulation of the Matter Power Spectrum
• Analysis of two-point statistics of cosmic shear: I. Estimators and covariances
• Concordance and Discordance in Cosmology
• The MICE Grand Challenge Lightcone Simulation I: Dark matter clustering
• Beyond linear galaxy alignments
• redMaGiC: Selecting Luminous Red Galaxies from the DES Science Verification Data
• The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: cosmological implications of the configuration-space clustering wedges
• Dark Energy Survey Year 1 Results: Weak Lensing Shape Catalogues
• Dark Energy Survey Year 1 Results: Redshift distributions of the weak lensing source galaxies
• KiDS-450: The tomographic weak lensing power spectrum and constraints on cosmological parameters
• Simultaneous measurement of cosmology and intrinsic alignments using joint cosmic shear and galaxy number density correlations
• Super-Sample Covariance in Simulations
• The MICE Grand Challenge Lightcone Simulation III: Galaxy lensing mocks from all-sky lensing maps
• Euclid preparation: II. The EuclidEmulator -- A tool to compute the cosmology dependence of the nonlinear matter power spectrum
• The MICE Grand Challenge Lightcone Simulation II: Halo and Galaxy catalogues
• RegPT: Direct and fast calculation of regularized cosmological power spectrum at two-loop order
• Cosmology from Cosmic Shear with DES Science Verification Data
• Cosmology from large-scale structure: Constraining $\Lambda$CDM with BOSS
• Modelling baryonic feedback for survey cosmology
• An algorithm to build mock galaxy catalogues using MICE simulations
• Efficient Cosmological Analysis of the SDSS/BOSS data from the Effective Field Theory of Large-Scale Structure
• KiDS+VIKING-450 and DES-Y1 combined: Cosmology with cosmic shear
• Improving lognormal models for cosmological fields
• Efficient Cosmological Parameter Estimation from Microwave Background Anisotropies
• KiDS-1000 catalogue: Redshift distributions and their calibration
• Measuring the effective complexity of cosmological models
• KiDS-1000 catalogue: Weak gravitational lensing shear measurements
• Probability Distribution Function of Cosmological Density Fluctuations from Gaussian Initial Condition: Comparison of One- and Two-point Log-normal Model Predictions with N-body Simulations
• Optimal Surveys for Weak Lensing Tomography
• KiDS+VIKING-450 and DES-Y1 combined: Mitigating baryon feedback uncertainty with COSEBIs
• Comprehensive Two-Point Analyses of Weak Gravitational Lensing Surveys
• Galaxy-galaxy lensing estimators and their covariance properties
• Photometric Redshift Calibration with Self Organising Maps
• KiDS+VIKING-450: A new combined optical & near-IR dataset for cosmology and astrophysics
• Weak lensing power spectra for precision cosmology: Multiple-deflection, reduced shear and lensing bias corrections
• Modeling baryonic physics in future weak lensing surveys
• Accounting for baryonic effects in cosmic shear tomography: Determining a minimal set of nuisance parameters using PCA
• Quantifying tensions in cosmological parameters: Interpreting the DES evidence ratio
• The halo model as a versatile tool to predict intrinsic alignments
• Cosmic Shear Measurements with DES Science Verification Data
• On the assumption of Gaussianity for cosmological two-point statistics and parameter dependent covariance matrices
• Cosmic shear covariance: The log-normal approximation
• Survey geometry and the internal consistency of recent cosmic shear measurements
• Towards emulating cosmic shear data: Revisiting the calibration of the shear measurements for the Kilo-Degree Survey
• Improving measurements of H(z) and Da(z) by analyzing clustering anisotropies
• Dark Energy Survey Year 1 Results: Constraints on Intrinsic Alignments and their Colour Dependence from Galaxy Clustering and Weak Lensing
• Analysis of two-point statistics of cosmic shear: III. Covariances of shear measures made easy
• Baryonic effects for weak lensing. Part I. Power spectrum and covariance matrix
• The 2-degree Field Lensing Survey: design and clustering measurements
• Quantifying dimensionality: Bayesian cosmological model complexities
• Cosmological Simulations for Combined-Probe Analyses: Covariance and Neighbour-Exclusion Bias
• Measuring the growth of matter fluctuations with third-order galaxy correlations
• The Advanced Camera for Surveys General Catalog: Structural Parameters for Approximately Half a Million Galaxies
• Thinking Outside the Box: Effects of Modes Larger than the Survey on Matter Power Spectrum Covariance
• MPTbreeze: A fast renormalized perturbative scheme
• The Morphology of Galaxies in the Baryon Oscillation Spectroscopic Survey
• Accurate cosmic shear errors: do we need ensembles of simulations?
• On the complementarity of galaxy clustering with cosmic shear and flux magnification
• KiDS+VIKING-450: Improved cosmological parameter constraints from redshift calibration with self-organising maps
• Complete super-sample lensing covariance in the response approach
• The Astro-WISE Optical Image Pipeline: Development and Implementation
• Lensing Bias in Cosmic Shear
• On Combining Galaxy Clustering and Weak Lensing to Unveil Galaxy Biasing via the Halo Model
• Unveiling Galaxy Bias via the Halo Model, KiDS and GAMA
• Statistical Inconsistencies in the KiDS-450 Dataset
• Cosmic Shear Covariance Matrix in $w$CDM: Cosmology Matters
• Testing KiDS cross-correlation redshifts with simulations
• On the insufficiency of arbitrarily precise covariance matrices: non-Gaussian weak lensing likelihoods
• Dark Energy Survey Year 1 Results: The Impact of Galaxy Neighbours on Weak Lensing Cosmology with im3shape
• The skewed weak lensing likelihood: why biases arise, despite data and theory being sound
• The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: Angular clustering tomography and its cosmological implications
• Testing one-loop galaxy bias: Power spectrum
• Consistent cosmic shear in the face of systematics: a B-mode analysis of KiDS-450, DES-SV and CFHTLenS
• A bias in cosmic shear from galaxy selection: results from ray-tracing simulations
• Testing gravity using galaxy-galaxy lensing and clustering amplitudes in KiDS-1000, BOSS and 2dFLenS
• Quantifying Suspiciousness Within Correlated Data Sets
• Large scale systematic signals in weak lensing surveys
• Observational biases in flux magnification measurements
• Analysis of two-point statistics of cosmic shear: II. Optimizing the survey geometry
• The importance of magnification effects in galaxy-galaxy lensing
• Scale dependence of galaxy biasing investigated by weak gravitational lensing: An assessment using semi-analytic galaxies and simulated lensing data
• Euclid: The reduced shear approximation and magnification bias for Stage IV cosmic shear experiments
• Spherical Bayesian mass-mapping with uncertainties: full sky observations on the celestial sphere
• Non-Gaussianity in the Weak Lensing Correlation Function Likelihood -- Implications for Cosmological Parameter Biases
• Disentangling magnification in combined shear-clustering analyses
• Constrained correlation functions
• Fourier Band-Power E/B-mode Estimators for Cosmic Shear
• Stacked lensing estimators and their covariance matrices: Excess surface mass density vs. Lensing shear
• Estimating the weak-lensing rotation signal in radio cosmic shear surveys
• Localizing Transformations of the Galaxy-Galaxy Lensing Observable
• The effects of varying depth in cosmic shear surveys
• A New Data Compression Method and its Application to Cosmic Shear Analysis
• Minimising the impact of scale-dependent galaxy bias on the joint cosmological analysis of large scale structures

Cited by in corpus (92)

• The Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: Cosmological Implications from two Decades of Spectroscopic Surveys at the Apache Point observatory
• KiDS-1000 Cosmology: Multi-probe weak gravitational lensing and spectroscopic galaxy clustering constraints
• Euclid. I. Overview of the Euclid mission
• Dark Energy Survey Year 3 Results: Cosmology from Cosmic Shear and Robustness to Data Calibration
• Hyper Suprime-Cam Year 3 Results: Cosmology from Cosmic Shear Power Spectra
• Dark Energy Survey Year 3 Results: Weak Lensing Shape Catalogue
• COSMOPOWER: emulating cosmological power spectra for accelerated Bayesian inference from next-generation surveys
• A non-linear solution to the $S_8$ tension?
• KiDS-1000 catalogue: Redshift distributions and their calibration
• KiDS-1000 catalogue: Weak gravitational lensing shear measurements
• KiDS-1000 Cosmology: constraints beyond flat $\Lambda$CDM
• Cosmological constraints from unWISE and Planck CMB lensing tomography
• Consistent lensing and clustering in a low-$S_8$ Universe with BOSS, DES Year 3, HSC Year 1 and KiDS-1000
• Joint constraints on cosmology and the impact of baryon feedback: combining KiDS-1000 lensing with the thermal Sunyaev-Zeldovich effect from Planck and ACT
• Cosmic Shear Cosmology Beyond 2-Point Statistics: A Combined Peak Count and Correlation Function Analysis of DES-Y1
• KiDS-1000: cosmic shear with enhanced redshift calibration
• Euclid preparation: XIX. Impact of magnification on photometric galaxy clustering
• Euclid: impact of nonlinear prescriptions on cosmological parameter estimation from weak lensing cosmic shear
• Constraining baryonic feedback and cosmology with weak-lensing, X-ray, and kinematic Sunyaev-Zeldovich observations
• KiDS-1000: Combined halo-model cosmology constraints from galaxy abundance, galaxy clustering and galaxy-galaxy lensing
• Advances in Constraining Intrinsic Alignment Models with Hydrodynamic Simulations
• The Dark Energy Survey Year 3 and eBOSS: constraining galaxy intrinsic alignments across luminosity and colour space
• KiDS & Euclid: Cosmological implications of a pseudo angular power spectrum analysis of KiDS-1000 cosmic shear tomography
• KiDS-1000: Cosmology with improved cosmic shear measurements
• Cosmological Constraint Precision of the Photometric and Spectroscopic Multi-probe Surveys of China Space Station Telescope (CSST)
• Weak Lensing Tomographic Redshift Distribution Inference for the Hyper Suprime-Cam Subaru Strategic Program three-year shape catalogue
• Constraints on $S_8$ from a full-scale and full-shape analysis of redshift-space clustering and galaxy-galaxy lensing in BOSS
• Cosmology Intertwined: A Review of the Particle Physics, Astrophysics, and Cosmology Associated with the Cosmological Tensions and Anomalies
• Magnification bias in galaxy surveys with complex sample selection functions
• Dark Energy Survey Year 3 results: Marginalisation over redshift distribution uncertainties using ranking of discrete realisations
• KiDS-Legacy: Consistency of cosmic shear measurements and joint cosmological constraints with external probes
• KiDS-1000 cosmology: Combined second- and third-order shear statistics
• Cosmological inference from emulator based halo model I: Validation tests with HSC and SDSS mock catalogs
• KiDS-SBI: Simulation-based inference analysis of KiDS-1000 cosmic shear
• Constraints on anisotropic primordial non-Gaussianity from intrinsic alignments of SDSS-III BOSS galaxies
• KiDS-1000 Cosmology: Constraints from density split statistics
• A Unified Catalog-level Reanalysis of Stage-III Cosmic Shear Surveys
• Consistency of cosmic shear analyses in harmonic and real space
• Self-calibration and robust propagation of photometric redshift distribution uncertainties in weak gravitational lensing
• KiDS-1000 Cosmology: machine learning -- accelerated constraints on Interacting Dark Energy with COSMOPOWER
• On cosmological bias due to the magnification of shear and position samples in modern weak lensing analyses
• Constraining constant and tomographic coupled dark energy with low-redshift and high-redshift probes
• Cosmology from weak lensing alone and implications for the Hubble tension
• Ultra-large-scale approximations and galaxy clustering: debiasing constraints on cosmological parameters
• Galaxy morphoto-Z with neural Networks (GaZNets). I. Optimized accuracy and outlier fraction from Imaging and Photometry
• Sufficiency of a Gaussian power spectrum likelihood for accurate cosmology from upcoming weak lensing surveys
• A simulation-based inference pipeline for cosmic shear with the Kilo-Degree Survey
• Constraining dark matter decays with cosmic microwave background and weak lensing shear observations
• KiDS-1000: cross-correlation with Planck cosmic microwave background lensing and intrinsic alignment removal with self-calibration
• Shear Measurement with Poorly Resolved Images
• Probing the two-body decaying dark matter scenario with weak lensing and the cosmic microwave background
• The halo model with beyond-linear halo bias: unbiasing cosmological constraints from galaxy-galaxy lensing and clustering
• An empirical approach to model selection: weak lensing and intrinsic alignments
• KiDS+VIKING-450: An internal-consistency test for cosmic shear tomography with a colour-based split of source galaxies
• Constraint on the early-formed dark matter halos using the free-free emission in the Planck foreground analysis
• Three-point intrinsic alignments of dark matter halos in the IllustrisTNG simulation
• Constraining the physics of star formation from CIB-cosmic shear cross-correlations
• KiDS-Legacy: Covariance validation and the unified OneCovariance framework for projected large-scale structure observables
• A roadmap to cosmological parameter analysis with third-order shear statistics II: Analytic covariance estimate
• Forecast of cross-correlation of CSST cosmic shear tomography with AliCPT-1 CMB lensing
• A tomographic spherical mass map emulator of the KiDS-1000 survey using conditional generative adversarial networks
• Exploring the mass and redshift dependence of the cluster pressure profile with stacks on thermal SZ maps
• First step toward matter power spectrum reconstruction with Stage III weak gravitational lensing surveys
• Euclid preparation. LIX. Angular power spectra from discrete observations
• Euclid and KiDS-1000: Quantifying the impact of source-lens clustering on cosmic shear analyses
• Dark Energy Survey Year 3 Results: Constraints on cosmological parameters and galaxy bias models from galaxy clustering and galaxy-galaxy lensing using the redMaGiC sample
• A Systematic Study of Projection Biases in Weak Lensing Analysis
• What is the super-sample covariance? A fresh perspective for second-order shear statistics
• Starlet higher order statistics for galaxy clustering and weak lensing
• Pure-mode correlation functions for cosmic shear and application to KiDS-1000
• Constraining Hot Dark Matter Sub-Species with Weak Lensing and the Cosmic Microwave Background Radiation
• Impact of lensing magnification on the analysis of galaxy clustering in redshift space
• Simulation-based inference has its own Dodelson-Schneider effect (but it knows that it does)
• Informed total-error-minimizing priors: Interpretable cosmological parameter constraints despite complex nuisance effects
• Data Compression and Covariance Matrix Inspection: Cosmic Shear
• A frequentist view on the two-body decaying dark matter model
• KiDS-1000: Detection of deviations from a purely cold dark matter power spectrum with tomographic weak gravitational lensing
• Phenomenological power spectrum models for H$\alpha$ emission line galaxies from the Nancy Grace Roman Space Telescope
• Bounds on galaxy stochasticity from halo occupation distribution modeling
• Dark Energy Survey Year 3 results: Galaxy-halo connection from galaxy-galaxy lensing
• 6x2pt: Forecasting gains from joint weak lensing and galaxy clustering analyses with spectroscopic-photometric galaxy cross-correlations
• Illuminating the Dark Sector: Understanding Modified Gravity Signatures with Cross-Correlations of Gravitational Waves and Large-Scale Structure
• CMB lensing from early-formed dark matter halos
• Pixelization effects in cosmic shear angular power spectra
• Dusty Clump Survival in Supernova Ejecta: Dust-Mediated Growth vs. Crushing by the Reverse Shock
• A data compression and optimal galaxy weights scheme for Dark Energy Spectroscopic Instrument and weak lensing datasets
• Hyper Suprime-Cam Y3 results: photo-$z$ bias calibration with lensing shear ratios and cosmological constraints from cosmic shear
• Matching Bayesian and frequentist coverage probabilities when using an approximate data covariance matrix
• On Weak Lensing Response Functions
• Dark Energy Survey Year 3 results: Cosmology with peaks using an emulator approach
• Non-linear infusion of intrinsic alignment and source clustering: impact on non-Gaussian cosmic shear statistics
• Cosmic Shear in Harmonic Space from the Dark Energy Survey Year 1 Data: Compatibility with Configuration Space Results