Calibrating Redshift Distributions Beyond Spectroscopic Limits with Cross-Correlations
arXiv:0805.1409 · doi:10.1086/589982
Abstract
We describe a new method for measuring the true redshift distribution of any set of objects studied only photometrically. The angular cross-correlation between objects in a photometric sample with objects in some spectroscopic sample as a function of the spectroscopic z, in combination with standard correlation measurements, provides sufficient information to reconstruct the true redshift distribution of the photometric sample. This technique enables the robust calibration of photometric redshifts even beyond spectroscopic limits. The spectroscopic sample need not resemble the photometric one in galaxy properties, but must overlap in sky coverage and redshift range. We test this new technique with Monte Carlo simulations using realistic error estimates. RMS errors in recovering both the mean and sigma of the true, Gaussian redshift distribution of a single photometric redshift bin are 1.4x10^(-3) (sigma_z/0.1) (Sigma_p/10)^(-0.3) (dN_s/dz / 25,000)^(-0.5), where sigma_z is the true sigma of the redshift distribution, Sigma_p is the surface density of the photometric sample in galaxies/arcmin^2, and dN_s/dz is the number of galaxies with a spectroscopic redshift per unit z. We test the impact of redshift outliers and of a variety of sources of systematic error; none dominate measurement uncertainties in reasonable scenarios. With this method, the true redshift distributions of even arbitrarily faint photometric redshift samples may be determined to the precision required by proposed dark energy experiments (errors in mean and sigma below 3x10^(-3) at z~1) using expected extensions of current spectroscopic samples.
16 pages, including 8 figures and 2 tables; accepted for publication by the Astrophysical Journal
References in corpus (38)
- Wilkinson Microwave Anisotropy Probe (WMAP) Three Year Results: Implications for Cosmology
- Stable clustering, the halo model and nonlinear cosmological power spectra
- Halo Models of Large Scale Structure
- Spectroscopic Target Selection in the Sloan Digital Sky Survey: The Main Galaxy Sample
- Accurate photometric redshifts for the CFHT Legacy Survey calibrated using the VIMOS VLT Deep Survey
- Lyman Break Galaxies at z>4 and the Evolution of the UV Luminosity Density at High Redshift
- zCOSMOS: A Large VLT/VIMOS redshift survey covering 0 < z < 3 in the COSMOS field
- The Luminosity and Color Dependence of the Galaxy Correlation Function
- Probing Dark Energy with Baryonic Acoustic Oscillations from Future Large Galaxy Redshift Surveys
- Lyman Break Galaxies at Redshift z~3: Survey Description and Full Data Set
- The All-wavelength Extended Groth Strip International Survey (AEGIS) Data Sets
- A Survey of Star-Forming Galaxies in the z=1.4-2.5 `Redshift Desert': Overview
- Star formation in AEGIS field galaxies since z=1.1 . Staged galaxy formation, and a model of mass-dependent gas exhaustion
- The VIMOS VLT Deep Survey - First epoch VVDS-Deep survey: 11564 spectra with 17.5<=IAB<=24, and the redshift distribution over 0< z <=5
- Systematic Errors in Future Weak Lensing Surveys: Requirements and Prospects for Self-Calibration
- Weak Lensing and Cosmology
- The Clustering of Luminous Red Galaxies in the Sloan Digital Sky Survey Imaging Data
- Effect of Photometric Redshift Uncertainties on Weak Lensing Tomography
- The Gemini Deep Deep Survey: I. Introduction to the Survey, Catalogs and Composite Spectra
- The VIMOS-VLT Deep Survey: Evolution of the galaxy luminosity function up to z=2 in first epoch data
- The DEEP2 Galaxy Redshift Survey: The Relationship Between Galaxy Properties and Environment at z ~ 1
- First cosmic shear results from the Canada-France-Hawaii Telescope Wide Synoptic Legacy Survey
- Detection of Cosmic Magnification with the Sloan Digital Sky Survey
- Weak Lensing and Dark Energy
- The DEEP2 Galaxy Redshift Survey: Color and Luminosity Dependence of Galaxy Clustering at z~1
- The DEEP2 Galaxy Redshift Survey: Clustering of Galaxies in Early Data
- Evolution and Color-Dependence of the Galaxy Angular Correlation Function: 350,000 Galaxies in 5 Square Degrees
- Very Small-Scale Clustering and Merger Rate of Luminous Red Galaxies
- The DEEP2 Galaxy Redshift Survey: Clustering of Quasars and Galaxies at z=1
- The DEEP2 Galaxy Redshift Survey: Clustering of Galaxies as a Function of Luminosity at z=1
- Significant primordial star formation at redshifts z ~ 3-4
- Using Galaxy Two-point Correlation Functions to Determine the Redshift Distributions of Galaxies Binned by Photometric Redshift
- Measuring the Cosmic Equation of State with Counts of Galaxies II: Error Budget for the DEEP2 Redshift Survey
- The DEEP2 Galaxy Redshift Survey: Clustering of Groups and Group Galaxies at z~1
- Cosmic tomographies: baryon acoustic oscillations and weak lensing
- Baryon Oscillations and Consistency Tests for Photometrically-Determined Redshifts of Very Faint Galaxies
- Redshift Accuracy Requirements for Future Supernova and Number Count Surveys
- Weighing the Universe with Photometric Redshift Surveys and the Impact on Dark Energy Forecasts
Cited by in corpus (219)
- LSST: from Science Drivers to Reference Design and Anticipated Data Products
- Overview of the DESI Legacy Imaging Surveys
- Observational Probes of Cosmic Acceleration
- Wide-Field InfrarRed Survey Telescope-Astrophysics Focused Telescope Assets WFIRST-AFTA 2015 Report
- KiDS-450: Cosmological parameter constraints from tomographic weak gravitational lensing
- The SDSS-IV extended Baryon Oscillation Spectroscopic Survey: Overview and Early Data
- KiDS-1000 Cosmology: Multi-probe weak gravitational lensing and spectroscopic galaxy clustering constraints
- Euclid. I. Overview of the Euclid mission
- Cosmology from cosmic shear power spectra with Subaru Hyper Suprime-Cam first-year data
- Cosmology with cosmic shear observations: a review
- Dark Energy Survey Year 3 Results: Cosmology from Cosmic Shear and Robustness to Data Calibration
- Extended Limber Approximation
- Gravitational Lensing Analysis of the Kilo Degree Survey
- Weak lensing for precision cosmology
- KiDS+VIKING-450: Cosmic shear tomography with optical+infrared data
- CFHTLenS: Improving the quality of photometric redshifts with precision photometry
- A Cosmic Variance Cookbook
- The CosmoVerse White Paper: Addressing observational tensions in cosmology with systematics and fundamental physics
- The Intrinsic Alignment of Galaxies and its Impact on Weak Gravitational Lensing in an Era of Precision Cosmology
- Cosmological constraints from cosmic shear two-point correlation functions with HSC survey first-year data
- DESI and other dark energy experiments in the era of neutrino mass measurements
- The first-year shear catalog of the Subaru Hyper Suprime-Cam SSP Survey
- Hyper Suprime-Cam Year 3 Results: Cosmology from Cosmic Shear Power Spectra
- Mapping the Galaxy Color-Redshift Relation: Optimal Photometric Redshift Calibration Strategies for Cosmology Surveys
- Dark Energy Survey Year 1 Results: Redshift distributions of the weak lensing source galaxies
- Simultaneous measurement of cosmology and intrinsic alignments using joint cosmic shear and galaxy number density correlations
- Target Selection and Validation of DESI Emission Line Galaxies
- Dark Energy Survey Year 3 Results: Redshift Calibration of the Weak Lensing Source Galaxies
- KiDS+VIKING-450 and DES-Y1 combined: Cosmology with cosmic shear
- Accurate precision Cosmology with redshift unknown gravitational wave sources
- Combining cluster observables and stacked weak lensing to probe dark energy: Self-calibration of systematic uncertainties
- KiDS-1000 catalogue: Redshift distributions and their calibration
- The Effective Number Density of Galaxies for Weak Lensing Measurements in the LSST Project
- Photometric Redshift with Bayesian Priors on Physical Properties of Galaxies
- Redshift distributions of galaxies in the DES Science Verification shear catalogue and implications for weak lensing
- Growth of Cosmic Structure: Probing Dark Energy Beyond Expansion
- Ultra large-scale cosmology in next-generation experiments with single tracers
- Constraining Primordial non-Gaussianity with Bispectrum and Power Spectum from Upcoming Optical and Radio Surveys
- The Complete Calibration of the Color-Redshift Relation (C3R2) Survey: Survey Overview and Data Release 1
- Weak-lensing mass calibration of redMaPPer galaxy clusters in Dark Energy Survey Science Verification data
- WISE x SuperCOSMOS photometric redshift catalog: 20 million galaxies over 3pi steradians
- ArborZ: Photometric Redshifts Using Boosted Decision Trees
- Comprehensive Two-Point Analyses of Weak Gravitational Lensing Surveys
- Parameter constraints from cross-correlation of CMB lensing with galaxy clustering
- Cluster Mass Calibration at High Redshift: HST Weak Lensing Analysis of 13 Distant Galaxy Clusters from the South Pole Telescope Sunyaev-Zel'dovich Survey
- The Complete Calibration of the Color-Redshift Relation (C3R2) Survey: Analysis and Data Release 2
- On using angular cross-correlations to determine source redshift distributions
- Photometric Redshift Calibration with Self Organising Maps
- Density split statistics: Cosmological constraints from counts and lensing in cells in DES Y1 and SDSS data
- Measuring the distance-redshift relation with the cross-correlation of gravitational wave standard sirens and galaxies
- Photometric Redshifts for Next-Generation Surveys
- Phenotypic redshifts with self-organizing maps: A novel method to characterize redshift distributions of source galaxies for weak lensing
- Spectroscopic Needs for Imaging Dark Energy Experiments: Photometric Redshift Training and Calibration
- Recovering Redshift Distributions with Cross-Correlations: Pushing The Boundaries
- RCSLenS: The Red Cluster Sequence Lensing Survey
- The LSST DESC DC2 Simulated Sky Survey
- Dark Energy Survey Year 3 Results: Clustering Redshifts -- Calibration of the Weak Lensing Source Redshift Distributions with redMaGiC and BOSS/eBOSS
- Reconstructing Redshift Distributions with Cross-Correlations: Tests and an Optimized Recipe
- Evaluation of probabilistic photometric redshift estimation approaches for The Rubin Observatory Legacy Survey of Space and Time (LSST)
- Dark Energy Survey Year 1 Results: Cross-Correlation Redshifts - Methods and Systematics Characterization
- Cross-Correlation of spectroscopic and photometric galaxy surveys: cosmology from lensing and redshift distortions
- unWISE tomography of Planck CMB lensing
- Using neural networks to estimate redshift distributions. An application to CFHTLenS
- A General Study of the Influence of Catastrophic Photometric Redshift Errors on Cosmology with Cosmic Shear Tomography
- Scientific Synergy Between LSST and Euclid
- The-wiZZ: Clustering redshift estimation for everyone
- General Requirements on Matter Power Spectrum Predictions for Cosmology with Weak Lensing Tomography
- Horizon-AGN virtual observatory - 1. SED-fitting performance and forecasts for future imaging surveys
- Tomographic galaxy clustering with the Subaru Hyper Suprime-Cam first year public data release
- KiDS+VIKING-450: Improved cosmological parameter constraints from redshift calibration with self-organising maps
- Where are the Luminous Red Galaxies (LRGs)? Using correlation measurements and lensing to relate LRGs to dark matter halos
- Cosmology with the Large Synoptic Survey Telescope: an Overview
- Clustering-based Redshift Estimation: Comparison to Spectroscopic Redshifts
- KiDS-1000: cosmic shear with enhanced redshift calibration
- Distance, Growth Factor, and Dark Energy Constraints from Photometric Baryon Acoustic Oscillation and Weak Lensing Measurements
- Redshift inference from the combination of galaxy colors and clustering in a hierarchical Bayesian model
- The PAU Survey: An improved photo- sample in the COSMOS field
- Incompleteness Matters Not: Inference of from BBH-galaxy cross-correlations
- Reconstructing large-scale structure with neutral hydrogen surveys
- Testing KiDS cross-correlation redshifts with simulations
- The Cosmic Thermal History Probed by Sunyaev-Zeldovich Effect Tomography
- CFHTLenS and RCSLenS: Testing Photometric Redshift Distributions Using Angular Cross-Correlations with Spectroscopic Galaxy Surveys
- Extragalactic Imprints in Galactic Dust Maps
- Dark Energy Survey Year 3 Results: Calibration of Lens Sample Redshift Distributions using Clustering Redshifts with BOSS/eBOSS
- Inferring the Redshift Distribution of the Cosmic Infrared Background
- Photometric redshifts: estimating their contamination and distribution using clustering information
- Constraining the Baryon Abundance with the Kinematic Sunyaev-Zel'dovich Effect: Projected-Field Detection Using Planck, WMAP, and unWISE
- Cluster Magnification & the Mass-Richness Relation in CFHTLenS
- Selection biases in empirical p(z) methods for weak lensing
- Quantifying Photometric Redshift Errors in the Absence of Spectroscopic Redshifts
- Optimized Photometric Redshifts for the Cosmic Assembly Near-Infrared Deep Extragalactic Legacy Survey (CANDELS)
- The Atacama Cosmology Telescope: Cosmology from cross-correlations of unWISE galaxies and ACT DR6 CMB lensing
- Sample variance in photometric redshift calibration: cosmological biases and survey requirements
- 2dFLenS and KiDS: Determining source redshift distributions with cross-correlations
- Cosmology with dropout selection: Straw-man surveys and CMB lensing
- The impact of spectroscopic incompleteness in direct calibration of redshift distributions for weak lensing surveys
- Overconfidence in Photometric Redshift Estimation
- Dark Energy Survey Year 1 Results: Calibration of redMaGiC Redshift Distributions in DES and SDSS from Cross-Correlations
- Self calibration of gravitational shear-galaxy intrinsic ellipticity correlation in weak lensing surveys
- Redshift inference from the combination of galaxy colors and clustering in a hierarchical Bayesian model Application to realistic -body simulations
- Cosmic shear with small scales: DES-Y3, KiDS-1000 and HSC-DR1
- Calibrating photometric redshifts with intensity mapping observations
- Effects of Unstable Dark Matter on Large-Scale Structure and Constraints from Future Surveys
- Measuring Redshift-Space Distortions using Photometric Surveys
- Bayesian photometric redshifts with empirical training sets
- Broadband Intensity Tomography: Spectral Tagging of the Cosmic UV Background
- Photometric Redshift Calibration Requirements for WFIRST Weak Lensing Cosmology: Predictions from CANDELS
- Photometric Redshift Estimation Using Spectral Connectivity Analysis
- Self calibration of photometric redshift scatter in weak lensing surveys
- Clustering-based redshift estimation: application to VIPERS/CFHTLS
- Tomographic Magnification of Lyman Break Galaxies in The Deep Lens Survey
- Cross-correlating dark sirens and galaxies: constraints on from GWTC-3 of LIGO-Virgo-KAGRA
- Imaging Systematics and Clustering of DESI Main Targets
- The PAU Survey: Photometric redshifts using transfer learning from simulations
- Exploring the SDSS Photometric Galaxies with Clustering Redshifts
- Weak Lensing Tomographic Redshift Distribution Inference for the Hyper Suprime-Cam Subaru Strategic Program three-year shape catalogue
- Cross-Correlation of Planck CMB Lensing with DESI-Like LRGs
- Cosmology Intertwined: A Review of the Particle Physics, Astrophysics, and Cosmology Associated with the Cosmological Tensions and Anomalies
- Kernel-Based Emulator for the 3D Matter Power Spectrum from CLASS
- Cross-Correlation Redshift Calibration Without Spectroscopic Calibration Samples in DES Science Verification Data
- The MUSE Hubble Ultra Deep Field Survey: III. Testing photometric redshifts to 30th magnitude
- Sub-Megaparsec Individual Photometric Redshift Estimation from Cosmic Web Constraints
- Weak lensing magnification in the Dark Energy Survey Science Verification Data
- Interloper bias in future large-scale structure surveys
- Gravitational waves HI intensity mapping: cosmological and astrophysical applications
- Cross-correlating radio continuum surveys and CMB lensing: constraining redshift distributions, galaxy bias and cosmology
- Exploring the 2MASS Extended and Point Source Catalogs with Clustering Redshifts
- The Next Generation Virgo Cluster Survey. XV. The photometric redshift estimation for background sources
- Non-Gaussianity Constraints using Future Radio Continuum Surveys and the Multi-Tracer Technique
- Forward modeling of galaxy populations for cosmological redshift distribution inference
- Improving the reliability of photometric redshift with machine learning
- Leveraging 3D-HST Grism Redshifts to Quantify Photometric Redshift Performance
- Producing a BOSS-CMASS sample with DES imaging
- Cosmological Constraints with Clustering-Based Redshifts
- Clustering analysis of high-redshift Luminous Red Galaxies in Stripe 82
- DES Science Portal: Computing Photometric Redshifts
- Testing the accuracy of clustering redshift with simulations
- Hierarchical Bayesian inference of photometric redshifts with stellar population synthesis models
- The Integrated Sachs Wolfe effect: unWISE and Planck constraints on Dynamical Dark Energy
- ATLAS Probe: Breakthrough Science of Galaxy Evolution, Cosmology, Milky Way, and the Solar System
- Using Cross-Correlations to Calibrate Lensing Source Redshift Distributions: Improving Cosmological Constraints from Upcoming Weak Lensing Surveys
- Improving Correlation Function Fitting with Ridge Regression: Application to Cross-Correlation Reconstruction
- Self-calibration and robust propagation of photometric redshift distribution uncertainties in weak gravitational lensing
- A Joint Analysis for Cosmology and Photometric Redshift Calculation Using Cross Correlations
- Weak Gravitational Lensing as a Method to Constrain Unstable Dark Matter
- Cosmic Near-infrared Background Tomography with SPHEREx Using Galaxy Cross-correlations
- Calibrating photometric redshift distributions with cross-correlations
- Redshift-space distortions from the cross-correlation of photometric populations
- HI Intensity Mapping for Clustering-Based Redshift Estimation
- Photometric Redshift Uncertainties in Weak Gravitational Lensing Shear Analysis: Models and Marginalization
- Cross-correlating 2D and 3D galaxy surveys
- Bayesian photometric redshifts of blended sources
- Using angular two-point correlations to self-calibrate the photometric redshift distributions of DECaLS DR9
- A Composite Likelihood Approach for Inference under Photometric Redshift Uncertainty
- Estimating redshift distributions using Hierarchical Logistic Gaussian processes
- Combining spectroscopic and photometric surveys using angular cross-correlations II: Parameter constraints from different physical effects
- Cosmological constraints from weak lensing scattering transform using HSC Y1 data
- Analytical marginalisation over photometric redshift uncertainties in cosmic shear analyses
- DESI Legacy Imaging Surveys Data Release 9: Cosmological Constraints from Galaxy Clustering and Weak Lensing using the Minimal Bias Model
- Baryon Acoustic Oscillations in the projected cross-correlation function between the eBOSS DR16 quasars and photometric galaxies from the DESI Legacy Imaging Surveys
- Analytic marginalization of uncertainties in tomographic galaxy surveys
- Simultaneous Constraints on Cosmology and Photometric Redshift Bias from Weak Lensing and Galaxy Clustering
- Mass Functions, Luminosity Functions, and Completeness Measurements from Clustering Redshifts
- The Nature of Low Surface Brightness Galaxies in the Hyper Suprime-Cam Survey
- Everything we'd like to do with LSST data, but we don't know (yet) how
- Dark Energy Survey Year 3 Results: Redshift Calibration of the MagLim Lens Sample from the combination of SOMPZ and clustering and its impact on Cosmology
- The star formation history in the last 10 billion years from CIB cross-correlations
- Non-negative matrix factorization for self-calibration of photometric redshift scatter in weak lensing surveys
- A cross-correlation-based estimate of the galaxy luminosity function
- Euclid: Calibrating photometric redshifts with spectroscopic cross-correlations
- Dark Energy Survey: Galaxy Sample for the Baryonic Acoustic Oscillation Measurement from the Final Dataset
- Optimising Spectroscopic and Photometric Galaxy Surveys: Same-sky Benefits for Dark Energy and Modified Gravity
- Detecting ultra-high energy cosmic ray anisotropies through cross-correlations
- Cosmology from LOFAR Two-metre Sky Survey Data Release 2: Cross-correlation with the cosmic microwave background
- Machine-learning computation of distance modulus for local galaxies
- A Clipping Method to Mitigate the Impact of Catastrophic Photometric Redshift Errors on Weak Lensing Tomography
- Self-consistent redshift estimation using correlation functions without a spectroscopic reference sample
- Locating the Baryon Acoustic Peak
- Correcting cosmological parameter biases for all redshift surveys induced by estimating and reweighting redshift distributions
- Testing the SZ-based tomographic approach to the thermal history of the universe with pressure-density cross-correlations: Insights from the Magneticum simulation
- PAC in DESI. I. Galaxy Stellar Mass Function into the Frontier
- Giga-z: A 100,000 Object Superconducting Spectrophotometer for LSST Follow-up
- Angular Correlation Function Estimators Accounting for Contamination from Probabilistic Distance Measurements
- On constraining Cosmology and the Halo Mass Function with Weak Gravitational Lensing
- Combining cosmic shear data with correlated photo- uncertainties: constraints from DESY1 and HSC-DR1
- Baryon acoustic oscillations with the cross-correlation of spectroscopic and photometric samples
- Effects of Redshift Uncertainty on Cross-Correlations of CMB Lensing and Galaxy Surveys
- The many flavours of photometric redshifts
- Euclid: Photometric redshift calibration with the clustering redshifts technique
- Improved Weak Lensing Photometric Redshift Calibration via StratLearn and Hierarchical Modeling
- Augmenting photometric redshift estimates using spectroscopic nearest neighbours
- Galaxy And Mass Assembly (GAMA): Galaxy Luminosity Function down to via Clustering Based Redshift Inference
- Euclid: Photometric redshift calibration with self-organising maps
- A Framework for Measuring Weak-Lensing Magnification Using the Fundamental Plane
- Optimising the shape of photometric redshift distributions with clustering cross-correlations
- Galaxy Redshifts from Discrete Optimization of Correlation Functions
- Upcoming searches for decaying dark matter with ULTRASAT ultraviolet maps
- Forecasts for Broadband Intensity Mapping of the Ultraviolet-Optical Background with CASTOR and SPHEREx
- Measurement of the evolving galaxy luminosity and mass function using clustering-based redshift inference
- Optimizing Redshift Distribution Inference through Joint Self-Calibration and Clustering-Redshift Synergy
- Observing galaxy mergers at the epoch of reionization
- Counting quasar--radio source pairs to derive the millijansky radio luminosity function and clustering strength to z=3.5
- Constraining ultraviolet emission with the upcoming ULTRASAT satellite
- Reconstructing redshift distributions with photometric galaxy clustering
- 6x2pt: Forecasting gains from joint weak lensing and galaxy clustering analyses with spectroscopic-photometric galaxy cross-correlations
- Euclid: Constraining ensemble photometric redshift distributions with stacked spectroscopy
- Impact of redshift distribution uncertainties on Lyman-break galaxy cosmological parameter inference
- Constraining Source Redshift Distributions with Gravitational Lensing
- Mapping the cosmic expansion history from LIGO-Virgo-KAGRA in synergy with DESI and SPHEREx
- Euclid Preparation: XIV. The Complete Calibration of the Color-Redshift Relation (C3R2) Survey: Data Release 3
- Dark Energy Survey Year 1 Results: Photometric Data Set for Cosmology
- Preliminary clustering properties of the DESI BGS bright targets using DR9 Legacy Imaging Surveys
- A direct detection method of galaxy intrinsic ellipticity-gravitational shear correlation in non-linear regimes using self-calibration
- Calibrating systematic errors in the distance determination with the luminosity-distance space large scale structure of dark sirens and its potential applications
- Clustering redshifts with the 21cm-galaxy cross-bispectrum
- Photometric Redshift Estimation with Convolutional Neural Networks and Galaxy Images: A Case Study of Resolving Biases in Data-Driven Methods
- CMB lensing tomography with clustering estimation of lens redshift distributions
- Addressing Dipole Tension via Clustering in CDM and beyond
- Euclid: Early Release Observations. Weak gravitational lensing analysis of Abell 2390