KiDS-Legacy: Covariance validation and the unified OneCovariance framework for projected large-scale structure observables

Abstract

We introduce OneCovariance, an open-source software designed to accurately compute covariance matrices for an arbitrary set of two-point summary statistics across a variety of large-scale structure tracers. Utilising the halo model, we estimated the statistical properties of matter and biased tracer fields, incorporating all Gaussian, non-Gaussian, and super-sample covariance terms. The flexible configuration permits user-specific parameters, such as the complexity of survey geometry, the halo occupation distribution employed to define each galaxy sample, or the form of the real-space and/or Fourier space statistics to be analysed. We illustrate the capabilities of OneCovariance within the context of a cosmic shear analysis of the final data release of the Kilo-Degree Survey (KiDS-Legacy). Upon comparing our estimated covariance with measurements from mock data and calculations from independent software, we ascertain that OneCovariance achieves accuracy at the per cent level. When assessing the impact of ignoring complex survey geometry in the cosmic shear covariance computation, we discover misestimations at approximately the $10\%$ level for cosmic variance terms. Nonetheless, these discrepancies do not significantly affect the KiDS-Legacy recovery of cosmological parameters. We derive the cross-covariance between real-space correlation functions, bandpowers, and COSEBIs, facilitating future consistency tests among these three cosmic shear statistics. Additionally, we calculate the covariance matrix of photometric-spectroscopic galaxy clustering measurements, validating the jackknife covariance estimates for calibrating KiDS-Legacy redshift distributions. The OneCovariance can be found on GitHub, together with comprehensive documentation and examples.

37 pages, 11 figures, published in A&A, code available at https://github.com/rreischke/OneCovariance

References in corpus (54)

• Array Programming with NumPy
• The Astropy Project: Sustaining and Growing a Community-oriented Open-source Project and the Latest Major Release (v5.0) of the Core Package
• Dark Energy Survey Year 3 Results: Cosmological Constraints from Galaxy Clustering and Weak Lensing
• Why your model parameter confidences might be too optimistic -- unbiased estimation of the inverse covariance matrix
• KiDS-1000 Cosmology: Cosmic shear constraints and comparison between two point statistics
• KiDS-1000 Cosmology: Multi-probe weak gravitational lensing and spectroscopic galaxy clustering constraints
• The Effective Field Theory of Cosmological Large Scale Structures
• Dark energy constraints from cosmic shear power spectra: impact of intrinsic alignments on photometric redshift requirements
• Dark Energy Survey Year 3 Results: Cosmology from Cosmic Shear and Robustness to Data Calibration
• Extended Limber Approximation
• The fourth data release of the Kilo-Degree Survey: ugri imaging and nine-band optical-IR photometry over 1000 square degrees
• Hyper Suprime-Cam Year 3 Results: Cosmology from Cosmic Shear Power Spectra
• Estimating the Redshift Distribution of Faint Galaxy Samples
• The BACCO Simulation Project: Exploiting the full power of large-scale structure for cosmology
• COSMOPOWER: emulating cosmological power spectra for accelerated Bayesian inference from next-generation surveys
• Modelling baryonic feedback for survey cosmology
• KiDS-1000 catalogue: Redshift distributions and their calibration
• KiDS-1000 catalogue: Weak gravitational lensing shear measurements
• KiDS-1000 Methodology: Modelling and inference for joint weak gravitational lensing and spectroscopic galaxy clustering analysis
• Probing dark energy with cluster counts and cosmic shear power spectra: including the full covariance
• The halo model as a versatile tool to predict intrinsic alignments
• Dark Energy Survey Year 3 Results: Covariance Modelling and its Impact on Parameter Estimation and Quality of Fit
• 2D-FFTLog: Efficient computation of real space covariance matrices for galaxy clustering and weak lensing
• An EFT description of galaxy intrinsic alignments
• A hydrodynamical halo model for weak-lensing cross correlations
• Shear Power Spectrum Reconstruction using Pseudo-Spectrum Method
• The halo model for cosmology: a pedagogical review
• Massive data compression for parameter-dependent covariance matrices
• Testing KiDS cross-correlation redshifts with simulations
• Cosmic shear power spectra in practice
• On the insufficiency of arbitrarily precise covariance matrices: non-Gaussian weak lensing likelihoods
• KiDS-1000: Combined halo-model cosmology constraints from galaxy abundance, galaxy clustering and galaxy-galaxy lensing
• KiDS & Euclid: Cosmological implications of a pseudo angular power spectrum analysis of KiDS-1000 cosmic shear tomography
• Including beyond-linear halo bias in halo models
• The fifth data release of the Kilo Degree Survey: Multi-epoch optical/NIR imaging covering wide and legacy-calibration fields
• Unbiased pseudo-Cl power spectrum estimation with mode projection
• Non-linear shrinkage estimation of large-scale structure covariance
• KiDS-Legacy calibration: unifying shear and redshift calibration with the SKiLLS multi-band image simulations
• Creating Jackknife and Bootstrap estimates of the covariance matrix for the two-point correlation function
• Breaking baryon-cosmology degeneracy with the electron density power spectrum
• KiDS-SBI: Simulation-based inference analysis of KiDS-1000 cosmic shear
• The N5K Challenge: Non-Limber Integration for LSST Cosmology
• GLASS: Generator for Large Scale Structure
• Organised Randoms: Learning and correcting for systematic galaxy clustering patterns in KiDS using self-organising maps
• Fast and realistic large-scale structure from machine-learning-augmented random field simulations
• A New Data Compression Method and its Application to Cosmic Shear Analysis
• The unequal-time matter power spectrum: impact on weak lensing observables
• Minimising the impact of scale-dependent galaxy bias on the joint cosmological analysis of large scale structures
• A roadmap to cosmological parameter analysis with third-order shear statistics III: Efficient estimation of third-order shear correlation functions and an application to the KiDS-1000 data
• Statistics of a single sky: constrained random fields and the imprint of Bardeen potentials on galaxy clustering
• The 2-point correlation function covariance with fewer mocks
• The impact of signal-to-noise, redshift, and angular range on the bias of weak lensing 2-point functions
• KiDS-Legacy: Angular galaxy clustering from deep surveys with complex selection effects
• What is the super-sample covariance? A fresh perspective for second-order shear statistics

Cited by in corpus (7)

• The CosmoVerse White Paper: Addressing observational tensions in cosmology with systematics and fundamental physics
• KiDS-Legacy: Consistency of cosmic shear measurements and joint cosmological constraints with external probes
• Matter power spectrum reconstruction with KiDS-Legacy: Improved internal $\Lambda$CDM consistency and preference for strong baryonic feedback
• KiDS-Legacy: Constraints on Horndeski gravity from weak lensing combined with galaxy clustering and cosmic microwave background anisotropies
• KiDS-Legacy: Constraining dark energy, neutrino mass, and curvature
• Dusty Clump Survival in Supernova Ejecta: Dust-Mediated Growth vs. Crushing by the Reverse Shock
• Pixelization effects in cosmic shear angular power spectra