KiDS-Legacy: Angular galaxy clustering from deep surveys with complex selection effects

Abstract

Photometric galaxy surveys, despite their limited resolution along the line of sight, encode rich information about the large-scale structure (LSS) of the Universe thanks to the high number density and extensive depth of the data. However, the complicated selection effects in wide and deep surveys can potentially cause significant bias in the angular two-point correlation function (2PCF) measured from those surveys. In this paper, we measure the 2PCF from the newly published KiDS-Legacy sample. Given an $r$-band $5\sigma$ magnitude limit of $24.8$ and survey footprint of $1347$ deg${}^2$, it achieves an excellent combination of sky coverage and depth for such a measurement. We find that complex selection effects, primarily induced by varying seeing, introduce over-estimation of the 2PCF by approximately an order of magnitude. To correct for such effects, we apply a machine learning-based method to recover an organised random (OR) that presents the same selection pattern as the galaxy sample. The basic idea is to find the selection-induced clustering of galaxies using a combination of self-organising maps (SOMs) and hierarchical clustering (HC). This unsupervised machine learning method is able to recover complicated selection effects without specifying their functional forms. We validate this SOM+HC method on mock deep galaxy samples with realistic systematics and selections derived from the KiDS-Legacy catalogue. Using mock data, we demonstrate that the OR delivers unbiased 2PCF cosmological parameter constraints, removing the $27\sigma$ offset in the galaxy bias parameter that is recovered when adopting uniform randoms. Blinded measurements on the real KiDS-Legacy data show that the corrected 2PCF is robust to the SOM+HC configuration near the optimal set-up suggested by the mock tests.

arXiv comment29 pages, 27 figures, 4 tables; Accepted for publication on Astronomy & Astrophysics; The code used for this work is published on https://github.com/yanzastro/tiaogeng

References in corpus (85)

• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• Array Programming with NumPy
• Maps of Dust IR Emission for Use in Estimation of Reddening and CMBR Foregrounds
• emcee: The MCMC Hammer
• Measuring Reddening with SDSS Stellar Spectra and Recalibrating SFD
• The Gaia mission
• HEALPix -- a Framework for High Resolution Discretization, and Fast Analysis of Data Distributed on the Sphere
• Gaia Data Release 3: Summary of the content and survey properties
• Binary companions of evolved stars in APOGEE DR14: Search method and catalog of ~5,000 companions
• The Eleventh and Twelfth Data Releases of the Sloan Digital Sky Survey: Final Data from SDSS-III
• Halo Models of Large Scale Structure
• Overview of the DESI Legacy Imaging Surveys
• The Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: Cosmological Implications from two Decades of Spectroscopic Surveys at the Apache Point observatory
• Dark Energy Survey Year 3 Results: Cosmological Constraints from Galaxy Clustering and Weak Lensing
• Bayesian photometric redshift estimation
• Analytic model for galaxy and dark matter clustering
• The Dark Energy Survey: more than dark energy - an overview
• KiDS-450: Cosmological parameter constraints from tomographic weak gravitational lensing
• Halo occupation numbers and galaxy bias
• Theoretical Models of the Halo Occupation Distribution: Separating Central and Satellite Galaxies
• Large-Scale Galaxy Bias
• KiDS-1000 Cosmology: Cosmic shear constraints and comparison between two point statistics
• KiDS-1000 Cosmology: Multi-probe weak gravitational lensing and spectroscopic galaxy clustering constraints
• CFHTLenS: The Canada-France-Hawaii Telescope Lensing Survey
• Cosmological Non-Linearities as an Effective Fluid
• The Effective Field Theory of Cosmological Large Scale Structures
• Euclid. I. Overview of the Euclid mission
• Dark Energy Survey Year 3 Results: Cosmology from Cosmic Shear and Robustness to Data Calibration
• Bayesian Galaxy Shape Measurement for Weak Lensing Surveys - III. Application to the Canada-France-Hawaii Telescope Lensing Survey
• A unified pseudo-$C_{\ell }$ framework
• Dark Energy Survey Year 3 Results: Cosmology from Cosmic Shear and Robustness to Modeling Uncertainty
• Cosmology from the Chinese Space Station Optical Survey (CSS-OS)
• Core Cosmology Library: Precision Cosmological Predictions for LSST
• Power Spectrum Super-Sample Covariance
• The Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: BAO and RSD measurements from the anisotropic power spectrum of the Quasar sample between redshift 0.8 and 2.2
• CosmoLike - Cosmological Likelihood Analyses for Photometric Galaxy Surveys
• KiDS+GAMA: Cosmology constraints from a joint analysis of cosmic shear, galaxy-galaxy lensing and angular clustering
• Analysis of two-point statistics of cosmic shear: I. Estimators and covariances
• Hyper Suprime-Cam Year 3 Results: Cosmology from Cosmic Shear Power Spectra
• Ameliorating Systematic Uncertainties in the Angular Clustering of Galaxies: A Study using SDSS-III
• Baryon Acoustic Oscillations and the Hubble Constant: Past, Present and Future
• Dark Energy Survey Year 3 Results: Redshift Calibration of the Weak Lensing Source Galaxies
• Cosmology from large-scale structure: Constraining $\Lambda$CDM with BOSS
• Galaxy clustering in the CFHTLS-Wide: the changing relationship between galaxies and haloes since z ~ 1.2
• KiDS-1000 catalogue: Redshift distributions and their calibration
• Cosmic microwave background anisotropy power spectrum statistics for high precision cosmology
• The Pseudo-$C_l$ method: Cosmic microwave background anisotropy power spectrum statistics for high precision cosmology
• Clustering of Sloan Digital Sky Survey III Photometric Luminous Galaxies: The Measurement, Systematics and Cosmological Implications
• Dark Energy Survey Year 1 Results: Galaxy clustering for combined probes
• The APM Galaxy Survey III: An Analysis of Systematic Errors in the Angular Correlation Function and Cosmological Implications
• Optimization of the Observing Cadence for the Rubin Observatory Legacy Survey of Space and Time: a pioneering process of community-focused experimental design
• Photometric Redshift Calibration with Self Organising Maps
• KiDS+VIKING-450: A new combined optical & near-IR dataset for cosmology and astrophysics
• Euclid preparation: X. The Euclid photometric-redshift challenge
• Dependence of cosmic shear covariances on cosmology - Impact on parameter estimation
• No galaxy left behind: accurate measurements with the faintest objects in the Dark Energy Survey
• Galaxy clustering, photometric redshifts and diagnosis of systematics in the DES Science Verification data
• Hyper Suprime-Cam Year 3 Results: Cosmology from Galaxy Clustering and Weak Lensing with HSC and SDSS using the Minimal Bias Model
• Estimating the large-scale angular power spectrum in the presence of systematics: a case study of Sloan Digital Sky Survey quasars
• Upper Bound of Neutrino Masses from Combined Cosmological Observations and Particle Physics Experiments
• The 2-degree Field Lensing Survey: design and clustering measurements
• Somoclu: An Efficient Parallel Library for Self-Organizing Maps
• Dark Energy Survey Year 3 Results: Optimizing the Lens Sample in Combined Galaxy Clustering and Galaxy-Galaxy Lensing Analysis
• Dark Energy Survey Year 3 Results: Galaxy clustering and systematics treatment for lens galaxy samples
• Tomographic galaxy clustering with the Subaru Hyper Suprime-Cam first year public data release
• Dark Energy Survey Year 3 Results: Measuring the Survey Transfer Function with Balrog
• The halo model for cosmology: a pedagogical review
• Exploiting the full potential of photometric quasar surveys: Optimal power spectra through blind mitigation of systematics
• Testing KiDS cross-correlation redshifts with simulations
• Bright galaxy sample in the Kilo-Degree Survey Data Release 4: selection, photometric redshifts, and physical properties
• Improving Galaxy Clustering Measurements with Deep Learning: analysis of the DECaLS DR7 data
• KiDS-1000: Combined halo-model cosmology constraints from galaxy abundance, galaxy clustering and galaxy-galaxy lensing
• Mitigating contamination in LSS surveys: a comparison of methods
• Blinding multi-probe cosmological experiments
• The fifth data release of the Kilo Degree Survey: Multi-epoch optical/NIR imaging covering wide and legacy-calibration fields
• Dark Energy Survey Year 3 results: cosmology from combined galaxy clustering and lensing -- validation on cosmological simulations
• KiDS-Legacy calibration: unifying shear and redshift calibration with the SKiLLS multi-band image simulations
• Measurement of the thermal Sunyaev-Zel'dovich effect around cosmic voids
• Mitigating Systematic Errors in Angular Correlation Function Measurements from Wide Field Surveys
• GLASS: Generator for Large Scale Structure
• Organised Randoms: Learning and correcting for systematic galaxy clustering patterns in KiDS using self-organising maps
• The effects of varying depth in cosmic shear surveys
• Enhancing Photometric Redshift Catalogs Through Color-Space Analysis: Application to KiDS-Bright Galaxies
• Joint inference of multiplicative and additive systematics in galaxy density fluctuations and clustering measurements
• Cosmology with Galaxy Correlations

Cited by in corpus (4)

• KiDS-Legacy: Consistency of cosmic shear measurements and joint cosmological constraints with external probes
• KiDS-Legacy: Covariance validation and the unified OneCovariance framework for projected large-scale structure observables
• Dusty Clump Survival in Supernova Ejecta: Dust-Mediated Growth vs. Crushing by the Reverse Shock
• Systematics mitigation for catalogue-based angular power spectra