Incorporating Photometric Redshift Probability Density Information into Real-Space Clustering Measurements

Abstract

The use of photometric redshifts in cosmology is increasing. Often, however these photo-zs are treated like spectroscopic observations, in that the peak of the photometric redshift, rather than the full probability density function (PDF), is used. This overlooks useful information inherent in the full PDF. We introduce a new real-space estimator for one of the most used cosmological statistics, the 2-point correlation function, that weights by the PDF of individual photometric objects in a manner that is optimal when Poisson statistics dominate. As our estimator does not bin based on the PDF peak it substantially enhances the clustering signal by usefully incorporating information from all photometric objects that overlap the redshift bin of interest. As a real-world application, we measure QSO clustering in the Sloan Digital Sky Survey (SDSS). We find that our simplest binned estimator improves the clustering signal by a factor equivalent to increasing the survey size by a factor of 2-3. We also introduce a new implementation that fully weights between pairs of objects in constructing the cross-correlation and find that this pair-weighted estimator improves clustering signal in a manner equivalent to increasing the survey size by a factor of 4-5. Our technique uses spectroscopic data to anchor the distance scale and it will be particularly useful where spectroscopic data (e.g, from BOSS) overlaps deeper photometry (e.g.,from Pan-STARRS, DES or the LSST). We additionally provide simple, informative expressions to determine when our estimator will be competitive with the autocorrelation of spectroscopic objects. Although we use QSOs as an example population, our estimator can and should be applied to any clustering estimate that uses photometric objects.

Replaced with accepted version. Major changes have been made, in that we now directly demonstrate the full, PDF pair-weighted clustering estimator and show that it increases the clustering signal even more substantially

References in corpus (21)

• Five-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Likelihoods and Parameters from the WMAP data
• The Sixth Data Release of the Sloan Digital Sky Survey
• The Sloan Digital Sky Survey Quasar Catalog IV. Fifth Data Release
• Clustering of High Redshift ($z\ge 2.9$) Quasars from the Sloan Digital Sky Survey
• Efficient Photometric Selection of Quasars from the Sloan Digital Sky Survey: II. ~1,000,000 Quasars from Data Release Six
• The 2dF-SDSS LRG and QSO Survey: QSO clustering and the L-z degeneracy
• Clustering Analyses of 300,000 Photometrically Classified Quasars--I. Luminosity and Redshift Evolution in Quasar Bias
• Luminosity and redshift dependent quasar clustering
• Clustering Analyses of 300,000 Photometrically Classified Quasars--II. The Excess on Very Small Scales
• Quasar Clustering at $25\kpch$ from a Complete Sample of Binaries
• The real-space clustering of luminous red galaxies around z<0.6 quasars in the Sloan Digital Sky Survey
• The Small-Scale Environment of Quasars
• Using Galaxy Two-point Correlation Functions to Determine the Redshift Distributions of Galaxies Binned by Photometric Redshift
• Robust Machine Learning Applied to Astronomical Datasets III: Probabilistic Photometric Redshifts for Galaxies and Quasars in the SDSS and GALEX
• Eight-Dimensional Mid-Infrared/Optical Bayesian Quasar Selection
• Quasar candidates selection in the Virtual Observatory era
• QSO-LRG 2-Point Cross-Correlation Function and Redshift-Space Distorions
• AGN Environments in the Sloan Digital Sky Survey I: Dependence on Type, Redshift, and Luminosity
• A reliable cluster detection technique using photometric redshifts: introducing the 2TecX algorithm
• On estimating redshift and luminosity distributions in photometric redshift surveys
• An Improved Photometric Calibration of the Sloan Digital Sky Survey Imaging Data

Cited by in corpus (41)

• Overview of the DESI Legacy Imaging Surveys
• Dusty Star-Forming Galaxies at High Redshift
• Data Mining and Machine Learning in Astronomy
• The clustering of massive galaxies at z~0.5 from the first semester of BOSS data
• TPZ : Photometric redshift PDFs and ancillary information by using prediction trees and random forests
• The clustering of intermediate redshift quasars as measured by the Baryon Oscillation Spectroscopic Survey
• ANNz2 - photometric redshift and probability distribution function estimation using machine learning
• The LABOCA Survey of the Extended Chandra Deep Field South: Clustering of submillimetre galaxies
• Galaxy clustering in the NEWFIRM Medium Band Survey: the relationship between stellar mass and dark matter halo mass at 1 < z < 2
• Selecting Quasars by their Intrinsic Variability
• Photometric redshifts and quasar probabilities from a single, data-driven generative model
• SOMz: photometric redshift PDFs with self organizing maps and random atlas
• Clustering of obscured and unobscured quasars in the Bootes field: Placing rapidly growing black holes in the cosmic web
• Cross-Correlation of SDSS DR7 Quasars and DR10 BOSS Galaxies: The Weak Luminosity Dependence of Quasar Clustering at z~0.5
• The Field X-ray AGN Fraction to z=0.7 from the Chandra Multiwavelength Project and the Sloan Digital Sky Survey
• The Angular Clustering of Infrared-Selected Obscured and Unobscured Quasars
• Cosmology with the Large Synoptic Survey Telescope: an Overview
• Exhausting the Information: Novel Bayesian Combination of Photometric Redshift PDFs
• Morpho-z: improving photometric redshifts with galaxy morphology
• The ALHAMBRA survey: Accurate merger fractions by PDF analysis of photometric close pairs
• Measuring the Dark Matter Halo Mass of X-ray AGN at z~1 using photometric redshifts
• A machine learning approach to galaxy properties: joint redshift-stellar mass probability distributions with Random Forest
• Imaging Systematics and Clustering of DESI Main Targets
• The Halo Occupation Distribution of X-ray-Bright Active Galactic Nuclei: A Comparison with Luminous Quasars
• Large scale clustering measurements with photometric redshifts: comparing the dark matter halos of X-ray AGN, star-forming and passive galaxies at z~1
• Leveraging 3D-HST Grism Redshifts to Quantify Photometric Redshift Performance
• Photometric redshifts with machine learning, lights and shadows on a complex data science use case
• An ALMA survey of the SCUBA-2 Cosmology Legacy SurveyUKIDSS/UDS Field: Halo Masses for Submillimetre Galaxies
• The clustering of submillimeter galaxies detected with ALMA
• The Chandra COSMOS Legacy Survey: Clustering of X-ray selected AGN at 2.9<z<5.5 using photometric redshift Probability Distribution Functions
• The ALHAMBRA survey : $B-$band luminosity function of quiescent and star-forming galaxies at $0.2\le z<1$ by PDF analysis
• Sparse Representation of Photometric Redshift PDFs: Preparing for Petascale Astronomy
• Galaxy clustering with photometric surveys using PDF redshift information
• Clustering of Extremely Red Objects in Elais-N1 from the UKIDSS DXS with optical photometry from Pan-STARRS1 and Subaru
• The ALHAMBRA survey : Estimation of the clustering signal encoded in the cosmic variance
• The PAU Survey: Photometric redshift estimation in deep wide fields
• Accurate Modeling of the Projected Galaxy Clustering in Photometric Surveys: I. Tests with Mock Catalogs
• Gaussian Mixture Models for Blended Photometric Redshifts
• CLAP. I. Resolving miscalibration for deep learning-based galaxy photometric redshift estimation
• A model of the anisotropic correlation function xi(rp, pi) in redshift space including redshift errors
• Clustering analysis of medium-band selected high-redshift galaxies