Estimating the Redshift Distribution of Faint Galaxy Samples
arXiv:0801.3822 · doi:10.1111/j.1365-2966.2008.13510.x
Abstract
We present an empirical method for estimating the underlying redshift distribution N(z) of galaxy photometric samples from photometric observables. The method does not rely on photometric redshift (photo-z) estimates for individual galaxies, which typically suffer from biases. Instead, it assigns weights to galaxies in a spectroscopic subsample such that the weighted distributions of photometric observables (e.g., multi-band magnitudes) match the corresponding distributions for the photometric sample. The weights are estimated using a nearest-neighbor technique that ensures stability in sparsely populated regions of color-magnitude space. The derived weights are then summed in redshift bins to create the redshift distribution. We apply this weighting technique to data from the Sloan Digital Sky Survey as well as to mock catalogs for the Dark Energy Survey, and compare the results to those from the estimation of photo-z's derived by a neural network algorithm. We find that the weighting method accurately recovers the underlying redshift distribution, typically better than the photo-z reconstruction, provided the spectroscopic subsample spans the range of photometric observables covered by the photometric sample.
14 pages, 9 figures, submitted to MNRAS
References in corpus (24)
- The All-wavelength Extended Groth Strip International Survey (AEGIS) Data Sets
- ANNz: estimating photometric redshifts using artificial neural networks
- Systematic Errors in Future Weak Lensing Surveys: Requirements and Prospects for Self-Calibration
- A Deep, Wide Field, Optical, and Near Infrared Catalog of a Large Area around the Hubble Deep Field North
- The Galaxy-mass Correlation Function Measured from Weak Lensing in the SDSS
- The Team Keck Treasury Redshift Survey of the GOODS-North Field
- Effect of Photometric Redshift Uncertainties on Weak Lensing Tomography
- The CANADA-FRANCE REDSHIFT SURVEY I: Introduction to the Survey, Photometric Catalogs and Surface Brightness Selection Effects
- The CNOC2 Field Galaxy Luminosity Function I: A Description of Luminosity Function Evolution
- A large sample of spectroscopic redshifts in the ACS-GOODS region of the HDF-N
- The 2dF-SDSS LRG and QSO (2SLAQ) Luminous Red Galaxy Survey
- The DEEP Groth Strip Galaxy Redshift Survey. III. Redshift Catalog and Properties of Galaxies
- A Galaxy Photometric Redshift Catalog for the Sloan Digital Sky Survey Data Release 6
- Precision photometric redshift calibration for galaxy-galaxy weak lensing
- The CNOC2 Field Galaxy Redshift Survey I: The Survey and the Catalog for the Patch CNOC 0223+00
- The evolution of the galaxy luminosity function in the rest frame blue band up to z=3.5
- Photometric Redshift Requirements for Self-Calibration of Cluster Dark Energy Studies
- Photometric Redshifts for the Dark Energy Survey and VISTA and Implications for Large Scale Structure
- Baryon Oscillations and Consistency Tests for Photometrically-Determined Redshifts of Very Faint Galaxies
- Redshift Accuracy Requirements for Future Supernova and Number Count Surveys
- On estimating redshift and luminosity distributions in photometric redshift surveys
- Photometric Redshifts with Surface Brightness Priors
- The DEEP2 Redshift Survey
- Color Tomography
Cited by in corpus (152)
- KiDS-450: Cosmological parameter constraints from tomographic weak gravitational lensing
- Cosmology from cosmic shear power spectra with Subaru Hyper Suprime-Cam first-year data
- Cosmology with cosmic shear observations: a review
- Weak lensing for precision cosmology
- KiDS+VIKING-450: Cosmic shear tomography with optical+infrared data
- Photometric Redshifts for Hyper Suprime-Cam Subaru Strategic Program Data Release 1
- The CosmoVerse White Paper: Addressing observational tensions in cosmology with systematics and fundamental physics
- First measurement of the Hubble constant from a dark standard siren using the Dark Energy Survey galaxies and the LIGO/Virgo binary-black-hole merger GW170814
- TPZ : Photometric redshift PDFs and ancillary information by using prediction trees and random forests
- KiDS+GAMA: Cosmology constraints from a joint analysis of cosmic shear, galaxy-galaxy lensing and angular clustering
- The third data release of the Kilo-Degree Survey and associated data products
- Lensing is Low: Cosmology, Galaxy Formation, or New Physics?
- Dark Energy Survey Year 1 Results: Redshift distributions of the weak lensing source galaxies
- ANNz2 - photometric redshift and probability distribution function estimation using machine learning
- KiDS-450: The tomographic weak lensing power spectrum and constraints on cosmological parameters
- Photometric redshift analysis in the Dark Energy Survey Science Verification data
- Dark Energy Survey Year 3 Results: Redshift Calibration of the Weak Lensing Source Galaxies
- KiDS+VIKING-450 and DES-Y1 combined: Cosmology with cosmic shear
- KiDS-1000 catalogue: Redshift distributions and their calibration
- Cosmology constraints from shear peak statistics in Dark Energy Survey Science Verification data
- Cosmological constraints with deep learning from KiDS-450 weak lensing maps
- Redshift distributions of galaxies in the DES Science Verification shear catalogue and implications for weak lensing
- KiDS+VIKING-450 and DES-Y1 combined: Mitigating baryon feedback uncertainty with COSEBIs
- WISE x SuperCOSMOS photometric redshift catalog: 20 million galaxies over 3pi steradians
- ArborZ: Photometric Redshifts Using Boosted Decision Trees
- Cross-correlation Weak Lensing of SDSS Galaxy Clusters I: Measurements
- CFHTLenS tomographic weak lensing: Quantifying accurate redshift distributions
- The Complete Calibration of the Color-Redshift Relation (C3R2) Survey: Analysis and Data Release 2
- A statistical standard siren measurement of the Hubble constant from the LIGO/Virgo gravitational wave compact object merger GW190814 and Dark Energy Survey galaxies
- On using angular cross-correlations to determine source redshift distributions
- DNF - Galaxy photometric redshift by Directional Neighbourhood Fitting
- Photometric Redshift Calibration with Self Organising Maps
- Catastrophic photometric redshift errors: weak lensing survey requirements
- Weak lensing analysis of SZ-selected clusters of galaxies from the SPT and Planck surveys
- Euclid preparation: X. The Euclid photometric-redshift challenge
- Phenotypic redshifts with self-organizing maps: A novel method to characterize redshift distributions of source galaxies for weak lensing
- Sunyaev-Zel'dovich Effect and X-ray Scaling Relations from Weak-Lensing Mass Calibration of 32 SPT Selected Galaxy Clusters
- Spectroscopic Needs for Imaging Dark Energy Experiments: Photometric Redshift Training and Calibration
- No galaxy left behind: accurate measurements with the faintest objects in the Dark Energy Survey
- All-purpose, all-sky photometric redshifts for the Legacy Imaging Surveys Data Release 8
- Cross-correlation Weak Lensing of SDSS Galaxy Clusters III: Mass-to-light Ratios
- AMICO galaxy clusters in KiDS-DR3: weak-lensing mass calibration
- Cosmic Shear Cosmology Beyond 2-Point Statistics: A Combined Peak Count and Correlation Function Analysis of DES-Y1
- Source Selection for Cluster Weak Lensing Measurements in the Hyper Suprime-Cam Survey
- Evaluation of probabilistic photometric redshift estimation approaches for The Rubin Observatory Legacy Survey of Space and Time (LSST)
- The LOFAR Two-metre Sky Survey IV. First Data Release: Photometric redshifts and rest-frame magnitudes
- Dark Energy Survey Year 1 Results: Cross-Correlation Redshifts - Methods and Systematics Characterization
- Shedding Light on the Galaxy Luminosity Function
- Dark Energy Survey Year 3 Results: Optimizing the Lens Sample in Combined Galaxy Clustering and Galaxy-Galaxy Lensing Analysis
- A Sparse Gaussian Process Framework for Photometric Redshift Estimation
- Photometric redshifts for the Kilo-Degree Survey. Machine-learning analysis with artificial neural networks
- The-wiZZ: Clustering redshift estimation for everyone
- Scientific Synergy Between LSST and Euclid
- A General Study of the Influence of Catastrophic Photometric Redshift Errors on Cosmology with Cosmic Shear Tomography
- Tomographic galaxy clustering with the Subaru Hyper Suprime-Cam first year public data release
- KiDS+VIKING-450: Improved cosmological parameter constraints from redshift calibration with self-organising maps
- Photometric Redshift Estimation with a Convolutional Neural Network: NetZ
- KiDS-1000: cosmic shear with enhanced redshift calibration
- On the realistic validation of photometric redshifts, or why Teddy will never be Happy
- Photometric Redshift Error Estimators
- KiDS+2dFLenS+GAMA: Testing the cosmological model with the statistic
- Testing KiDS cross-correlation redshifts with simulations
- Exhausting the Information: Novel Bayesian Combination of Photometric Redshift PDFs
- Photometric redshifts for the next generation of deep radio continuum surveys - II. Gaussian processes and hybrid estimates
- A Unified Analysis of Four Cosmic Shear Surveys
- Clustering of Photometric Luminous Red Galaxies II: Cosmological Implications from the Baryon Acoustic Scale
- Morpho-z: improving photometric redshifts with galaxy morphology
- Photometric Redshift Probability Distributions for Galaxies in the SDSS DR8
- Selection biases in empirical p(z) methods for weak lensing
- Sample variance in photometric redshift calibration: cosmological biases and survey requirements
- 2dFLenS and KiDS: Determining source redshift distributions with cross-correlations
- Strong detection of the CMB lensingxgalaxy weak lensingcross-correlation from ACT-DR4,PlanckLegacy and KiDS-1000
- The impact of spectroscopic incompleteness in direct calibration of redshift distributions for weak lensing surveys
- Photometric redshifts for galaxies in the Subaru Hyper Suprime-Cam and unWISE and a catalogue of identified clusters of galaxies
- Bayesian photometric redshifts with empirical training sets
- Cosmic shear with small scales: DES-Y3, KiDS-1000 and HSC-DR1
- Redshift inference from the combination of galaxy colors and clustering in a hierarchical Bayesian model Application to realistic -body simulations
- Clustering of photometric luminous red galaxies I : Growth of Structure and Baryon Acoustic Feature
- KiDS-1000: Cosmology with improved cosmic shear measurements
- Data augmentation for machine learning redshifts applied to SDSS galaxies
- Photo-z Performance for Precision Cosmology
- Spectroscopic failures in photometric redshift calibration: cosmological biases and survey requirements
- Combining Dark Energy Survey Science Verification Data with Near Infrared Data from the ESO VISTA Hemisphere Survey
- Weak Lensing Tomographic Redshift Distribution Inference for the Hyper Suprime-Cam Subaru Strategic Program three-year shape catalogue
- Cosmology Intertwined: A Review of the Particle Physics, Astrophysics, and Cosmology Associated with the Cosmological Tensions and Anomalies
- Cross-Correlation Redshift Calibration Without Spectroscopic Calibration Samples in DES Science Verification Data
- Kernel-Based Emulator for the 3D Matter Power Spectrum from CLASS
- The MUSE Hubble Ultra Deep Field Survey: III. Testing photometric redshifts to 30th magnitude
- KiDS-i-800: Comparing weak gravitational lensing measurements in same-sky surveys
- Persistent homology in cosmic shear II: A tomographic analysis of DES-Y1
- KiDS-Legacy: Consistency of cosmic shear measurements and joint cosmological constraints with external probes
- Non-Gaussianity Constraints using Future Radio Continuum Surveys and the Multi-Tracer Technique
- Forward modeling of galaxy populations for cosmological redshift distribution inference
- Testing gravity with galaxy-galaxy lensing and redshift-space distortions using CFHT-Stripe 82, CFHTLenS and BOSS CMASS datasets
- Galaxy-Galaxy Lensing in HSC: Validation Tests and the Impact of Heterogeneous Spectroscopic Training Sets
- GAMA+KiDS: Empirical correlations between halo mass and other galaxy properties near the knee of the stellar-to-halo mass relation
- KiDS-450: Enhancing cosmic shear with clipping transformations
- DES Science Portal: Computing Photometric Redshifts
- A Unified Framework for Constructing, Tuning and Assessing Photometric Redshift Density Estimates in a Selection Bias Setting
- Improving Correlation Function Fitting with Ridge Regression: Application to Cross-Correlation Reconstruction
- Self-calibration and robust propagation of photometric redshift distribution uncertainties in weak gravitational lensing
- Comparison of Observed Galaxy Properties with Semianalytic Model Predictions using Machine Learning
- Calibrating photometric redshift distributions with cross-correlations
- Photometric Redshift Uncertainties in Weak Gravitational Lensing Shear Analysis: Models and Marginalization
- Augmenting machine learning photometric redshifts with Gaussian mixture models
- Using angular two-point correlations to self-calibrate the photometric redshift distributions of DECaLS DR9
- Hybrid photometric redshifts for sources in the COSMOS and XMM-LSS fields
- Analytical marginalisation over photometric redshift uncertainties in cosmic shear analyses
- DESI Legacy Imaging Surveys Data Release 9: Cosmological Constraints from Galaxy Clustering and Weak Lensing using the Minimal Bias Model
- How not to obtain the redshift distribution from probabilistic redshift estimates: Under what conditions is it not inappropriate to estimate the redshift distribution N(z) by stacking photo-z PDFs?
- SuperCLASS -- III. Weak lensing from radio and optical observations in Data Release 1
- Convolution and deconvolution based estimates of galaxy scaling relations from photometric redshift surveys
- Measuring the scale dependence of intrinsic alignments using multiple shear estimates
- The LOFAR Two-metre Sky Survey Deep Fields -- Data Release 1: IV. Photometric redshifts and stellar masses
- Simulation-based inference of deep fields: galaxy population model and redshift distributions
- Photometric Redshifts in the North Ecliptic Pole Wide Field based on a Deep Optical Survey with Hyper Suprime-Cam
- Euclid: Calibrating photometric redshifts with spectroscopic cross-correlations
- A cross-correlation-based estimate of the galaxy luminosity function
- High-Dimensional Density Ratio Estimation with Extensions to Approximate Likelihood Computation
- KiDS+VIKING-450: An internal-consistency test for cosmic shear tomography with a colour-based split of source galaxies
- A Clipping Method to Mitigate the Impact of Catastrophic Photometric Redshift Errors on Weak Lensing Tomography
- Applications of Machine-Learning Algorithms for Infrared Colour Selection of Galactic Wolf-Rayet Stars
- Constraints on dark matter and astrophysics from tomographic -ray cross-correlations
- KiDS-Legacy: Covariance validation and the unified OneCovariance framework for projected large-scale structure observables
- Mass Calibration of Galaxy Clusters at Redshift 0.1-1.0 using Weak Lensing in the Sloan Digital Sky Survey Stripe 82 Co-add
- The many flavours of photometric redshifts
- Gaussian Mixture Models for Blended Photometric Redshifts
- Stratified Learning: A General-Purpose Statistical Method for Improved Learning under Covariate Shift
- The shape of dark matter haloes: results from weak lensing in the Ultraviolet Near-Infrared Optical Northern Survey (UNIONS)
- Combining cosmic shear data with correlated photo- uncertainties: constraints from DESY1 and HSC-DR1
- Degradation analysis in the estimation of photometric redshifts from non-representative training sets
- Dark Energy Survey Deep Field photometric redshift performance and training incompleteness assessment
- Large scale correlations in gas traced by MgII absorbers around low mass galaxies
- Improved Weak Lensing Photometric Redshift Calibration via StratLearn and Hierarchical Modeling
- Reconstructing galaxy fundamental distributions and scaling relations from photometric redshift surveys. Applications to the SDSS early-type sample
- Euclid: Photometric redshift calibration with self-organising maps
- Optimising the shape of photometric redshift distributions with clustering cross-correlations
- Stochastic Order Redshift Technique (SORT): a simple, efficient and robust method to improve cosmological redshift measurements
- Optimizing Redshift Distribution Inference through Joint Self-Calibration and Clustering-Redshift Synergy
- Mapping Variations of Redshift Distributions with Probability Integral Transforms
- Pz Cats: Photometric redshift catalogs based on DES Y3 BAO sample
- Impact of redshift distribution uncertainties on Lyman-break galaxy cosmological parameter inference
- Reconstructing redshift distributions with photometric galaxy clustering
- Euclid Preparation: XIV. The Complete Calibration of the Color-Redshift Relation (C3R2) Survey: Data Release 3
- Euclid: Constraining ensemble photometric redshift distributions with stacked spectroscopy
- Dusty Clump Survival in Supernova Ejecta: Dust-Mediated Growth vs. Crushing by the Reverse Shock
- Lensing Without Borders. I. A Blind Comparison of the Amplitude of Galaxy-Galaxy Lensing Between Independent Imaging Surveys
- Dark Energy Survey Year 3 Results: Galaxy Sample for BAO Measurement
- Euclid: Early Release Observations. Weak gravitational lensing analysis of Abell 2390
- Cosmological implications of the full shape of anisotropic clustering measurements in BOSS and eBOSS
- Euclid: Improving redshift distribution reconstruction using a deep-to-wide transfer function
- Effect of Distance Errors: Applications to SDSS Early-Type Galaxies