Confronting missing observations with probability weights: Fourier space and generalised formalism

Abstract

Due to instrumental limitations, the nature of which vary from case to case, spectroscopic galaxy redshift surveys usually do not collect redshifts for all galaxies in the population of potential targets. Especially problematic is the entanglement between this incompleteness and the true cosmological signal, arising from the fact that the proportion of successful observations is typically lower in regions with higher density of galaxies. The result is a fictitious suppression of the galaxy clustering that, if not properly corrected, can impact severely on cosmological-parameter inference. Recent developments in the field have shown that an unbiased estimate of the 2-point correlation function in the presence of missing observations can be obtained by weighting each pair by its inverse probability of being targeted. In this work we expand on the concept of probability weights by developing a more mature statistical formalism, which provides us with a deeper understanding of their fundamental properties. We take advantage of this novel perspective to handle the problem of estimating the inverse probability, specifically, we discuss how to efficiently determine the weights from a finite set of realisations of the targeting and how to model exactly the resulting sampling effects. This allows us to derive an inverse-probability-based estimator for the power spectrum, which is the main result of this work, but also to improve robustness and computational efficiency of the already existing configuration-space estimator. Finally, we propose a strategy to further extend the concept of inverse probability, providing examples of how traditional missing-observation countermeasures can be included in this more general picture. The effectiveness of the different models and weighting schemes discussed in this work is demonstrated using realisations of an idealised simple survey strategy.

21 pages, 13 figures

References in corpus (30)

• The Eleventh and Twelfth Data Releases of the Sloan Digital Sky Survey: Final Data from SDSS-III
• The 2.5 m Telescope of the Sloan Digital Sky Survey
• The Baryon Oscillation Spectroscopic Survey of SDSS-III
• The clustering of galaxies in the SDSS-III Baryon Oscillation Spectroscopic Survey: Baryon Acoustic Oscillations in the Data Release 10 and 11 galaxy samples
• The DESI Experiment Part I: Science,Targeting, and Survey Design
• Power Spectrum Analysis of Three-Dimensional Redshift Surveys
• The clustering of galaxies in the SDSS-III Baryon Oscillation Spectroscopic Survey: Baryon Acoustic Oscillations in the Data Release 9 Spectroscopic Galaxy Sample
• The SDSS-IV extended Baryon Oscillation Spectroscopic Survey: Overview and Early Data
• The 2dF Galaxy Redshift Survey: correlation functions, peculiar velocities and the matter density of the Universe
• Halo concentrations in the standard LCDM cosmology
• Improving Cosmological Distance Measurements by Reconstruction of the Baryon Acoustic Peak
• The VIMOS Public Extragalactic Redshift Survey (VIPERS). An unprecedented view of galaxies and large-scale structure at 0.5<z<1.2
• The DESI Experiment Part II: Instrument Design
• Fast Estimators for Redshift-Space Clustering
• A 2.5% measurement of the growth rate from small-scale redshift space clustering of SDSS-III CMASS galaxies
• A Measurement of the Quadrupole Power Spectrum in the Clustering of the 2dF QSO Survey
• Measuring line-of-sight dependent Fourier-space clustering using FFTs
• A New Method to Correct for Fiber Collisions in Galaxy Two-Point Statistics
• An optimal FFT-based anisotropic power spectrum estimator
• Rapid modelling of the redshift-space power spectrum multipoles for a masked density field
• The Effect of Fiber Collisions on the Galaxy Power Spectrum Multipole
• Accelerating the 2-point and 3-point galaxy correlation functions using Fourier transforms
• Unbiased clustering estimation in the presence of missing observations
• Unbiased clustering estimates with the DESI fibre assignment
• The VIMOS Public Extragalactic Redshift Survey (VIPERS): Unbiased clustering estimate with VIPERS slit assignment
• Correcting for Fibre Assignment Incompleteness in the DESI Bright Galaxy Survey
• Imprint of DESI fiber assignment on the anisotropic power spectrum of emission line galaxies
• Mitigating the Impact of the DESI Fiber Assignment on Galaxy Clustering
• Using angular pair upweighting to improve 3D clustering measurements
• Tau flavored dark matter and its impact on tau Yukawa coupling

Cited by in corpus (8)

• The Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: measurement of the BAO and growth rate of structure of the luminous red galaxy sample from the anisotropic power spectrum between redshifts 0.6 and 1.0
• The Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: Pairwise-Inverse-Probability and Angular Correction for Fibre Collisions in Clustering Measurements
• Mitigation of DESI fiber assignment incompleteness effect on two-point clustering with small angular scale truncated estimators
• Generating mock galaxy catalogues for flux-limited samples like the DESI Bright Galaxy Survey
• Inpainting hydrodynamical maps with deep learning
• Toward accurate measurement of property-dependent galaxy clustering: II. Tests of the smoothed density-corrected $V_{\max }$ method
• Mitigating the impact of fiber assignment on the measurement of galaxy-lensing cross correlation
• Preliminary clustering properties of the DESI BGS bright targets using DR9 Legacy Imaging Surveys