Self-consistent redshift estimation using correlation functions without a spectroscopic reference sample
arXiv:1802.02581 · doi:10.1093/mnras/stz502
Abstract
We present a new method to estimate redshift distributions and galaxy-dark matter bias parameters using correlation functions in a fully data driven and self-consistent manner. Unlike other machine learning, template, or correlation redshift methods, this approach does not require a reference sample with known redshifts. By measuring the projected cross- and auto- correlations of different galaxy sub-samples, e.g., as chosen by simple cells in color-magnitude space, we are able to estimate the galaxy-dark matter bias model parameters, and the shape of the redshift distributions of each sub-sample. This method fully marginalises over a flexible parameterisation of the redshift distribution and galaxy-dark matter bias parameters of sub-samples of galaxies, and thus provides a general Bayesian framework to incorporate redshift uncertainty into the cosmological analysis in a data-driven, consistent, and reproducible manner. This result is improved by an order of magnitude by including cross-correlations with the CMB and with galaxy-galaxy lensing. We showcase how this method could be applied to real galaxies. By using idealised data vectors, in which all galaxy-dark matter model parameters and redshift distributions are known, this method is demonstrated to recover unbiased estimates on important quantities, such as the offset between the mean of the true and estimated redshift distribution and the 68\% and 95\% and 99.5\% widths of the redshift distribution to an accuracy required by current and future surveys.
arXiv comment20pages, 11 figures, text revised for clarification, version accepted by journal, conclusions unchanged
References in corpus (56)
- Scikit-learn: Machine Learning in Python
- emcee: The MCMC Hammer
- Planck 2015 results. XIII. Cosmological parameters
- HEALPix -- a Framework for High Resolution Discretization, and Fast Analysis of Data Distributed on the Sphere
- Cosmological parameters from CMB and other data: a Monte-Carlo approach
- LOFAR: The LOw-Frequency ARray
- Nine-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Final Maps and Results
- SDSS-III: Massive Spectroscopic Surveys of the Distant Universe, the Milky Way Galaxy, and Extra-Solar Planetary Systems
- Bayesian photometric redshift estimation
- KiDS-450: Cosmological parameter constraints from tomographic weak gravitational lensing
- The Tenth Data Release of the Sloan Digital Sky Survey: First Spectroscopic Data from the SDSS-III Apache Point Observatory Galactic Evolution Experiment
- CFHTLenS: The Canada-France-Hawaii Telescope Lensing Survey
- Spectral Classification and Redshift Measurement for the SDSS-III Baryon Oscillation Spectroscopic Survey
- ANNz: estimating photometric redshifts using artificial neural networks
- The Dark Energy Survey Data Release 1
- Biasing and Hierarchical Statistics in Large-scale Structure
- Systematic Errors in Future Weak Lensing Surveys: Requirements and Prospects for Self-Calibration
- Calibrating Redshift Distributions Beyond Spectroscopic Limits with Cross-Correlations
- The Zurich Extragalactic Bayesian Redshift Analyzer (ZEBRA) and its first application: COSMOS
- TPZ : Photometric redshift PDFs and ancillary information by using prediction trees and random forests
- Detection of Cosmic Magnification with the Sloan Digital Sky Survey
- Myths and Truths Concerning Estimation of Power Spectra
- Mapping the Galaxy Color-Redshift Relation: Optimal Photometric Redshift Calibration Strategies for Cosmology Surveys
- Dark Energy Survey Year 1 Results: Redshift distributions of the weak lensing source galaxies
- The Complete Calibration of the Color-Redshift Relation (C3R2) Survey: Survey Overview and Data Release 1
- ArborZ: Photometric Redshifts Using Boosted Decision Trees
- CFHTLenS tomographic weak lensing: Quantifying accurate redshift distributions
- CMB lensing tomography with the DES Science Verification galaxies
- Dark Energy Survey Year 1 Results: Galaxy-Galaxy Lensing
- Recovering Redshift Distributions with Cross-Correlations: Pushing The Boundaries
- Using Galaxy Two-point Correlation Functions to Determine the Redshift Distributions of Galaxies Binned by Photometric Redshift
- Dark Energy Survey Year 1 Results: Cross-Correlation Redshifts - Methods and Systematics Characterization
- Using neural networks to estimate redshift distributions. An application to CFHTLenS
- Star/galaxy separation at faint magnitudes: Application to a simulated Dark Energy Survey
- Clustering-based Redshift Estimation: Comparison to Spectroscopic Redshifts
- Neural Networks and Photometric Redshifts
- Photometric redshifts: estimating their contamination and distribution using clustering information
- Selection biases in empirical p(z) methods for weak lensing
- Dark Energy Survey Year 1 Results: Calibration of redMaGiC Redshift Distributions in DES and SDSS from Cross-Correlations
- GAz: A Genetic Algorithm for Photometric Redshift Estimation
- Data augmentation for machine learning redshifts applied to SDSS galaxies
- Clustering-based redshift estimation: application to VIPERS/CFHTLS
- Self calibration of photometric redshift scatter in weak lensing surveys
- Spectroscopic failures in photometric redshift calibration: cosmological biases and survey requirements
- Dark Energy Survey Year 1 Results: Galaxy Sample for BAO Measurement
- Cross-Correlation Redshift Calibration Without Spectroscopic Calibration Samples in DES Science Verification Data
- A Prescription for Galaxy Biasing Evolution as a Nuisance Parameter
- Cross-correlation of galaxies and galaxy clusters in the Sloan Digital Sky Survey and the importance of non-Poissonian shot noise
- Cosmological Constraints with Clustering-Based Redshifts
- Testing the accuracy of clustering redshift with simulations
- A Joint Analysis for Cosmology and Photometric Redshift Calculation Using Cross Correlations
- Learning from the machine: interpreting machine learning algorithms for point- and extended- source classification
- The Importance of Being First: Position Dependent Citation Rates on arXiv:astro-ph
- Simultaneous Constraints on Cosmology and Photometric Redshift Bias from Weak Lensing and Galaxy Clustering
- Correcting cosmological parameter biases for all redshift surveys induced by estimating and reweighting redshift distributions
- A New Approach to the Optimal Target Selection Problem
Cited by in corpus (6)
- Weak Lensing Tomographic Redshift Distribution Inference for the Hyper Suprime-Cam Subaru Strategic Program three-year shape catalogue
- Galaxy-Galaxy Lensing in HSC: Validation Tests and the Impact of Heterogeneous Spectroscopic Training Sets
- Self-calibration and robust propagation of photometric redshift distribution uncertainties in weak gravitational lensing
- A Composite Likelihood Approach for Inference under Photometric Redshift Uncertainty
- Estimating redshift distributions using Hierarchical Logistic Gaussian processes
- Effects of Redshift Uncertainty on Cross-Correlations of CMB Lensing and Galaxy Surveys