KiDS-Legacy: Covariance validation and the unified OneCovariance framework for projected large-scale structure observables
arXiv:2410.06962 · doi:10.1051/0004-6361/202452592
Abstract
We introduce OneCovariance, an open-source software designed to accurately compute covariance matrices for an arbitrary set of two-point summary statistics across a variety of large-scale structure tracers. Utilising the halo model, we estimated the statistical properties of matter and biased tracer fields, incorporating all Gaussian, non-Gaussian, and super-sample covariance terms. The flexible configuration permits user-specific parameters, such as the complexity of survey geometry, the halo occupation distribution employed to define each galaxy sample, or the form of the real-space and/or Fourier space statistics to be analysed. We illustrate the capabilities of OneCovariance within the context of a cosmic shear analysis of the final data release of the Kilo-Degree Survey (KiDS-Legacy). Upon comparing our estimated covariance with measurements from mock data and calculations from independent software, we ascertain that OneCovariance achieves accuracy at the per cent level. When assessing the impact of ignoring complex survey geometry in the cosmic shear covariance computation, we discover misestimations at approximately the level for cosmic variance terms. Nonetheless, these discrepancies do not significantly affect the KiDS-Legacy recovery of cosmological parameters. We derive the cross-covariance between real-space correlation functions, bandpowers, and COSEBIs, facilitating future consistency tests among these three cosmic shear statistics. Additionally, we calculate the covariance matrix of photometric-spectroscopic galaxy clustering measurements, validating the jackknife covariance estimates for calibrating KiDS-Legacy redshift distributions. The OneCovariance can be found on GitHub, together with comprehensive documentation and examples.
arXiv comment37 pages, 11 figures, published in A&A, code available at https://github.com/rreischke/OneCovariance
References in corpus (138)
- SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
- Array Programming with NumPy
- A Universal Density Profile from Hierarchical Clustering
- HEALPix -- a Framework for High Resolution Discretization, and Fast Analysis of Data Distributed on the Sphere
- The Astropy Project: Sustaining and Growing a Community-oriented Open-source Project and the Latest Major Release (v5.0) of the Core Package
- Efficient Computation of CMB anisotropies in closed FRW models
- Cosmological parameters from CMB and other data: a Monte-Carlo approach
- Weak Gravitational Lensing
- The Cosmic Linear Anisotropy Solving System (CLASS) II: Approximation schemes
- Halo Models of Large Scale Structure
- Large-Scale Structure of the Universe and Cosmological Perturbation Theory
- Physical Models of Galaxy Formation in a Cosmological Framework
- Dark Energy Survey Year 1 Results: Cosmological Constraints from Galaxy Clustering and Weak Lensing
- Dark Energy Survey Year 3 Results: Cosmological Constraints from Galaxy Clustering and Weak Lensing
- Revising the Halofit Model for the Nonlinear Matter Power Spectrum
- Analytic model for galaxy and dark matter clustering
- KiDS-450: Cosmological parameter constraints from tomographic weak gravitational lensing
- Wilkinson Microwave Anisotropy Probe (WMAP) First Year Observations: TE Polarization
- Dark matter halo concentrations in the Wilkinson Microwave Anisotropy Probe year 5 cosmology
- Why your model parameter confidences might be too optimistic -- unbiased estimation of the inverse covariance matrix
- Large-Scale Galaxy Bias
- KiDS-1000 Cosmology: Cosmic shear constraints and comparison between two point statistics
- KiDS-1000 Cosmology: Multi-probe weak gravitational lensing and spectroscopic galaxy clustering constraints
- MASTER of the CMB Anisotropy Power Spectrum: A Fast Method for Statistical Analysis of Large and Complex CMB Data Sets
- Dark Energy Survey Year 1 Results: Cosmological Constraints from Cosmic Shear
- CFHTLenS tomographic weak lensing cosmological parameter constraints: Mitigating the impact of intrinsic galaxy alignments
- The Effective Field Theory of Cosmological Large Scale Structures
- Intrinsic alignment-lensing interference as a contaminant of cosmic shear
- Cosmology from cosmic shear power spectra with Subaru Hyper Suprime-Cam first-year data
- CMB power spectrum parameter degeneracies in the era of precision cosmology
- Dark energy constraints from cosmic shear power spectra: impact of intrinsic alignments on photometric redshift requirements
- Dark Energy Survey Year 3 Results: Cosmology from Cosmic Shear and Robustness to Data Calibration
- Extended Limber Approximation
- The Kilo-Degree Survey
- A unified pseudo- framework
- Statistical Analysis of Galaxy Surveys - I. Robust error estimation for 2-point clustering statistics
- Cosmological parameters from lensing power spectrum and bispectrum tomography
- KiDS+VIKING-450: Cosmic shear tomography with optical+infrared data
- The Skewness of the Aperture Mass Statistic
- The fourth data release of the Kilo-Degree Survey: ugri imaging and nine-band optical-IR photometry over 1000 square degrees
- CosmoSIS: modular cosmological parameter estimation
- Core Cosmology Library: Precision Cosmological Predictions for LSST
- Galaxy alignments: An overview
- Power Spectrum Super-Sample Covariance
- Cosmological constraints from cosmic shear two-point correlation functions with HSC survey first-year data
- Massive Lossless Data Compression and Multiple Parameter Estimation from Galaxy Spectra
- CosmoLike - Cosmological Likelihood Analyses for Photometric Galaxy Surveys
- KiDS+GAMA: Cosmology constraints from a joint analysis of cosmic shear, galaxy-galaxy lensing and angular clustering
- Cosmological Constraints from a Combination of Galaxy Clustering and Lensing -- I. Theoretical Framework
- Analysis of two-point statistics of cosmic shear: I. Estimators and covariances
- The MICE Grand Challenge Lightcone Simulation I: Dark matter clustering
- Beyond linear galaxy alignments
- Hyper Suprime-Cam Year 3 Results: Cosmology from Cosmic Shear Power Spectra
- Putting the Precision in Precision Cosmology: How accurate should your data covariance matrix be?
- The Effect of Covariance Estimator Error on Cosmological Parameter Constraints
- Estimating the Redshift Distribution of Faint Galaxy Samples
- The BACCO Simulation Project: Exploiting the full power of large-scale structure for cosmology
- Super-Sample Covariance in Simulations
- Power Spectrum Covariance of Weak Gravitational Lensing
- The MICE Grand Challenge Lightcone Simulation II: Halo and Galaxy catalogues
- Galaxy Clustering & Galaxy-Galaxy Lensing: A Promising Union to Constrain Cosmological Parameters
- COSMOPOWER: emulating cosmological power spectra for accelerated Bayesian inference from next-generation surveys
- Cosmological Constraints from a Combination of Galaxy Clustering and Lensing -- III. Application to SDSS Data
- Modelling baryonic feedback for survey cosmology
- KiDS-1000 catalogue: Redshift distributions and their calibration
- Review: galactic angular momenta and angular momentum correlations in the cosmological large-scale structure
- KiDS-1000 catalogue: Weak gravitational lensing shear measurements
- Weak lensing analysis in three dimensions
- Redshift distributions of galaxies in the DES Science Verification shear catalogue and implications for weak lensing
- Precision calculations of the cosmic shear power spectrum projection
- Effect of baryonic feedback on two- and three-point shear statistics: prospects for detection and improved modelling
- KiDS-1000 Methodology: Modelling and inference for joint weak gravitational lensing and spectroscopic galaxy clustering analysis
- COSEBIs: Extracting the full E-/B-mode information from cosmic shear correlation functions
- Photometric Redshift Calibration with Self Organising Maps
- Probing dark energy with cluster counts and cosmic shear power spectra: including the full covariance
- The halo model as a versatile tool to predict intrinsic alignments
- Dependence of cosmic shear covariances on cosmology - Impact on parameter estimation
- Computing the Three-Point Correlation Function of Galaxies in Time
- The stellar-to-halo mass relation of GAMA galaxies from 100 square degrees of KiDS weak lensing data
- Cosmic Shear Measurements with DES Science Verification Data
- Dark Energy Survey Year 3 Results: Covariance Modelling and its Impact on Parameter Estimation and Quality of Fit
- Towards emulating cosmic shear data: Revisiting the calibration of the shear measurements for the Kilo-Degree Survey
- 2D-FFTLog: Efficient computation of real space covariance matrices for galaxy clustering and weak lensing
- An EFT description of galaxy intrinsic alignments
- Estimating Cosmological Parameter Covariance
- A hydrodynamical halo model for weak-lensing cross correlations
- Libsharp - spherical harmonic transforms revisited
- Cosmological Simulations for Combined-Probe Analyses: Covariance and Neighbour-Exclusion Bias
- Shear Power Spectrum Reconstruction using Pseudo-Spectrum Method
- Complete super-sample lensing covariance in the response approach
- The halo model for cosmology: a pedagogical review
- Performance of internal Covariance Estimators for Cosmic Shear Correlation Functions
- Massive data compression for parameter-dependent covariance matrices
- Unveiling Galaxy Bias via the Halo Model, KiDS and GAMA
- Cosmic shear power spectra in practice
- Testing KiDS cross-correlation redshifts with simulations
- On the insufficiency of arbitrarily precise covariance matrices: non-Gaussian weak lensing likelihoods
- Gravitational Lensing Simulations I : Covariance Matrices and Halo Catalogues
- Fitting the nonlinear matter bispectrum by the Halofit approach
- The ring statistics - how to separate E- and B-modes of cosmic shear correlation functions on a finite interval
- Cosmic shear full nulling: sorting out dynamics, geometry and systematics
- KiDS-1000: Combined halo-model cosmology constraints from galaxy abundance, galaxy clustering and galaxy-galaxy lensing
- The skewed weak lensing likelihood: why biases arise, despite data and theory being sound
- KiDS & Euclid: Cosmological implications of a pseudo angular power spectrum analysis of KiDS-1000 cosmic shear tomography
- Including beyond-linear halo bias in halo models
- The fifth data release of the Kilo Degree Survey: Multi-epoch optical/NIR imaging covering wide and legacy-calibration fields
- Consistent cosmic shear in the face of systematics: a B-mode analysis of KiDS-450, DES-SV and CFHTLenS
- Unbiased pseudo-Cl power spectrum estimation with mode projection
- Non-linear shrinkage estimation of large-scale structure covariance
- KiDS-Legacy calibration: unifying shear and redshift calibration with the SKiLLS multi-band image simulations
- Creating Jackknife and Bootstrap estimates of the covariance matrix for the two-point correlation function
- Cross-Correlation Redshift Calibration Without Spectroscopic Calibration Samples in DES Science Verification Data
- Breaking baryon-cosmology degeneracy with the electron density power spectrum
- Fast and easy super-sample covariance of large scale structure observables
- Unequal-Time Correlators for Cosmology
- Non-Gaussianity of the Cosmic Infrared Background anisotropies I : Diagrammatic formalism and application to the angular bispectrum
- KiDS-SBI: Simulation-based inference analysis of KiDS-1000 cosmic shear
- How covariant is the galaxy luminosity function?
- The N5K Challenge: Non-Limber Integration for LSST Cosmology
- Covariance of the galaxy angular power spectrum with the halo model
- GLASS: Generator for Large Scale Structure
- Organised Randoms: Learning and correcting for systematic galaxy clustering patterns in KiDS using self-organising maps
- Unequal time correlators and the Zeldovich approximation
- Cosmological Angular Trispectra and Non-Gaussian Covariance
- Fast and realistic large-scale structure from machine-learning-augmented random field simulations
- A New Data Compression Method and its Application to Cosmic Shear Analysis
- The unequal-time matter power spectrum: impact on weak lensing observables
- The cross-correlation between 3d cosmic shear and the integrated Sachs-Wolfe effect
- Minimising the impact of scale-dependent galaxy bias on the joint cosmological analysis of large scale structures
- A roadmap to cosmological parameter analysis with third-order shear statistics III: Efficient estimation of third-order shear correlation functions and an application to the KiDS-1000 data
- Variations of cosmic large-scale structure covariance matrices across parameter space
- 3D cosmic shear: numerical challenges, 3D lensing random fields generation and Minkowski Functionals for cosmological inference
- RCSLenS: A new estimator for large-scale galaxy-matter correlations
- Statistics of a single sky: constrained random fields and the imprint of Bardeen potentials on galaxy clustering
- The impact of signal-to-noise, redshift, and angular range on the bias of weak lensing 2-point functions
- The 2-point correlation function covariance with fewer mocks
- KiDS-Legacy: Angular galaxy clustering from deep surveys with complex selection effects
- What is the super-sample covariance? A fresh perspective for second-order shear statistics
Cited by in corpus (7)
- The CosmoVerse White Paper: Addressing observational tensions in cosmology with systematics and fundamental physics
- KiDS-Legacy: Consistency of cosmic shear measurements and joint cosmological constraints with external probes
- Matter power spectrum reconstruction with KiDS-Legacy: Improved internal CDM consistency and preference for strong baryonic feedback
- KiDS-Legacy: Constraints on Horndeski gravity from weak lensing combined with galaxy clustering and cosmic microwave background anisotropies
- KiDS-Legacy: Constraining dark energy, neutrino mass, and curvature
- Dusty Clump Survival in Supernova Ejecta: Dust-Mediated Growth vs. Crushing by the Reverse Shock
- Pixelization effects in cosmic shear angular power spectra