Euclid preparation: X. The Euclid photometric-redshift challenge

Abstract

Forthcoming large photometric surveys for cosmology require precise and accurate photometric redshift (photo-z) measurements for the success of their main science objectives. However, to date, no method has been able to produce photo-$z$s at the required accuracy using only the broad-band photometry that those surveys will provide. An assessment of the strengths and weaknesses of current methods is a crucial step in the eventual development of an approach to meet this challenge. We report on the performance of 13 photometric redshift code single value redshift estimates and redshift probability distributions (PDZs) on a common set of data, focusing particularly on the 0.2--2.6 redshift range that the Euclid mission will probe. We design a challenge using emulated Euclid data drawn from three photometric surveys of the COSMOS field. The data are divided into two samples: one calibration sample for which photometry and redshifts are provided to the participants; and the validation sample, containing only the photometry, to ensure a blinded test of the methods. Participants were invited to provide a redshift single value estimate and a PDZ for each source in the validation sample, along with a rejection flag that indicates sources they consider unfit for use in cosmological analyses. The performance of each method is assessed through a set of informative metrics, using cross-matched spectroscopic and highly-accurate photometric redshifts as the ground truth. We show that the rejection criteria set by participants are efficient in removing strong outliers, sources for which the photo-z deviates by more than 0.15(1+z) from the spectroscopic-redshift (spec-z). We also show that, while all methods are able to provide reliable single value estimates, several machine-learning methods do not manage to produce useful PDZs. [abridged]

arXiv commentAccepted in A&A, 25 pages, 13 figures, 7 tables

References in corpus (64)

• Scikit-learn: Machine Learning in Python
• Maps of Dust IR Emission for Use in Estimation of Reddening and CMBR Foregrounds
• Stellar population synthesis at the resolution of 2003
• The Dust Content and Opacity of Actively Star-Forming Galaxies
• LSST: from Science Drivers to Reference Design and Anticipated Data Products
• CANDELS: The Cosmic Assembly Near-infrared Deep Extragalactic Legacy Survey
• The Cosmic Evolution Survey (COSMOS) -- Overview
• EAZY: A Fast, Public Photometric Redshift Code
• Accurate photometric redshifts for the CFHT Legacy Survey calibrated using the VIMOS VLT Deep Survey
• The Great Observatories Origins Deep Survey: Initial Results From Optical and Near-Infrared Imaging
• COSMOS Photometric Redshifts with 30-bands for 2-deg2
• The COSMOS2015 Catalog: Exploring the 1<z<6 Universe with half a million galaxies
• The Hyper Suprime-Cam SSP Survey: Overview and Survey Design
• Mass assembly in quiescent and star-forming galaxies since z=4 from UltraVISTA
• Measuring and Modelling the Redshift Evolution of Clustering: the Hubble Deep Field North
• Spectral Energy Distributions of Hard X-ray selected AGNs in the XMDS Survey
• UltraVISTA: a new ultra-deep near-infrared survey in COSMOS
• The COSMOS Survey: Hubble Space Telescope / Advanced Camera for Surveys (HST/ACS) Observations and Data Processing
• ANNz: estimating photometric redshifts using artificial neural networks
• A Modified Magnitude System that Produces Well-Behaved Magnitudes, Colors, and Errors Even for Low Signal-to-Noise Ratio Measurements
• Weak Gravitational Lensing with COSMOS: Galaxy Selection and Shape Measurements
• A Critical Assessment of Photometric Redshift Methods: A CANDELS Investigation
• The Chandra COSMOS Legacy survey: optical/IR identifications
• Photometric Redshifts for Hyper Suprime-Cam Subaru Strategic Program Data Release 1
• Slicing Through Multicolor Space: Galaxy Redshifts From Broadband Photometry
• Measuring the Redshift Evolution of Clustering: the Hubble Deep Field South
• Dissecting Photometric redshift for Active Galactic Nuclei using XMM- and Chandra-COSMOS samples
• PHAT: PHoto-z Accuracy Testing
• The Blanco Cosmology Survey: Data Acquisition, Processing, Calibration, Quality Diagnostics and Data Release
• Stellar velocity dispersions and emission line properties of SDSS-III/BOSS galaxies
• Star-forming galaxies at very high redshifts
• Estimating the Redshift Distribution of Faint Galaxy Samples
• Mapping the Galaxy Color-Redshift Relation: Optimal Photometric Redshift Calibration Strategies for Cosmology Surveys
• Estimating photometric redshifts with artificial neural networks
• Photometric redshifts from SDSS images using a Convolutional Neural Network
• The Wide Field Infrared Survey Telescope: 100 Hubbles for the 2020s
• Pixel-based correction for Charge Transfer Inefficiency in the Hubble Space Telescope Advanced Camera for Surveys
• Photometric redshift estimation via deep learning
• Photometric Redshifts in the IRAC Shallow Survey
• The Complete Calibration of the Color-Redshift Relation (C3R2) Survey: Survey Overview and Data Release 1
• The Complete Calibration of the Color-Redshift Relation (C3R2) Survey: Analysis and Data Release 2
• DNF - Galaxy photometric redshift by Directional Neighbourhood Fitting
• GPz: Non-stationary sparse Gaussian processes for heteroscedastic uncertainty estimation in photometric redshifts
• A blind test of photometric redshift prediction
• A Comparison of Six Photometric Redshift Methods Applied to 1.5 Million Luminous Red Galaxies
• Photometric redshifts for Quasars in multi band Surveys
• Evaluation of probabilistic photometric redshift estimation approaches for The Rubin Observatory Legacy Survey of Space and Time (LSST)
• METAPHOR: A machine learning based method for the probability density estimation of photometric redshifts
• A Sparse Gaussian Process Framework for Photometric Redshift Estimation
• Perfecting the Photometric Calibration of the ACS CCD Cameras
• Neural Networks and Photometric Redshifts
• Photometric redshifts for the next generation of deep radio continuum surveys - II. Gaussian processes and hybrid estimates
• Galaxy Populations in Massive Galaxy Clusters to z=1.1: Color Distribution, Concentration, Halo Occupation Number and Red Sequence Fraction
• Morpho-z: improving photometric redshifts with galaxy morphology
• New Approaches To Photometric Redshift Prediction Via Gaussian Process Regression In The Sloan Digital Sky Survey
• CPz: Classification-aided photometric-redshift estimation
• Improving Photometric Redshift Estimation using GPz: size information, post processing and improved photometry
• Photometric redshift estimation based on data mining with PhotoRApToR
• Detection and Removal of Artifacts in Astronomical Images
• SED-dependent Galactic Extinction Prescription for Euclid and Future Cosmological Surveys
• Statistical analysis of probability density functions for photometric redshifts through the KiDS-ESO-DR3 galaxies
• The Efficacy of Galaxy Shape Parameters in Photometric Redshift Estimation: A Neural Network Approach
• Euclid preparation: VIII. The Complete Calibration of the Colour-Redshift Relation survey: VLT/KMOS observations and data release
• CosmoDM and its application to Pan-STARRS data

Cited by in corpus (61)

• Euclid. I. Overview of the Euclid mission
• DES Y3 + KiDS-1000: Consistent cosmology combining cosmic shear surveys
• Photometric Redshifts for Next-Generation Surveys
• All-purpose, all-sky photometric redshifts for the Legacy Imaging Surveys Data Release 8
• A machine learning approach to galaxy properties: joint redshift-stellar mass probability distributions with Random Forest
• A review of unsupervised learning in astronomy
• Photometric redshift-aided classification using ensemble learning
• The first large catalogue of spectroscopic redshifts in Webb's First Deep Field, SMACS J0723.3$-$7327
• Probing dark energy with tomographic weak-lensing aperture mass statistics
• Photometric Redshifts from SDSS Images with an Interpretable Deep Capsule Network
• Machine Learning for Observational Cosmology
• Cosmology and Astrophysics with Standard Sirens and Galaxy Catalogs in View of Future Gravitational Wave Observations
• [CII] line intensity mapping the epoch of reionization with the Prime-Cam on FYST
• Improving the reliability of photometric redshift with machine learning
• Photometric redshifts with machine learning, lights and shadows on a complex data science use case
• Benchmarking and Scalability of Machine Learning Methods for Photometric Redshift Estimation
• Combining the CLAUDS & HSC-SSP surveys: U+grizy(+YJHKs) photometry and photometric redshifts for 18M galaxies in the 20 deg2 of the HSC-SSP Deep and ultraDeep fields
• GLASS: Generator for Large Scale Structure
• Euclid preparation: XII. Optimizing the photometric sample of the Euclid survey for galaxy clustering and galaxy-galaxy lensing analyses
• On the detection and precise localisation of merging black holes events through strong gravitational lensing
• Euclid preparation: XXII. Selection of Quiescent Galaxies from Mock Photometry using Machine Learning
• Euclid: Early Release Observations -- Overview of the Perseus cluster and analysis of its luminosity and stellar mass functions
• PhotoRedshift-MML: a multimodal machine learning method for estimating photometric redshifts of quasars
• Euclid preparation. XXI. Intermediate-redshift contaminants in the search for $z>6$ galaxies within the Euclid Deep Survey
• Photometric redshift estimation of galaxies in the DESI Legacy Imaging Surveys
• A Machine Learning Approach to Predict Missing Flux Densities in Multi-band Galaxy Surveys
• Euclid: Calibrating photometric redshifts with spectroscopic cross-correlations
• Euclid preparation: XX. The Complete Calibration of the Color-Redshift Relation survey: LBT observations and data release
• Improving machine learning-derived photometric redshifts and physical property estimates using unlabelled observations
• PICZL: Image-based Photometric Redshifts for AGN
• ULISSE: A Tool for One-shot Sky Exploration and its Application to Active Galactic Nuclei Detection
• HOLISMOKES XIII: Strong-lens candidates at all mass scales and their environments from the Hyper-Suprime Cam and deep learning
• Euclid preparation. LI. Forecasting the recovery of galaxy physical properties and their relations with template-fitting and machine-learning methods
• VST-GAME: Galaxy Assembly as a function of Mass and Environment with VST. Photometric assessment and density field of MACSJ0416
• Euclid and KiDS-1000: Quantifying the impact of source-lens clustering on cosmic shear analyses
• Euclid preparation. LXVIII. Extracting physical parameters from galaxies with machine learning
• Euclid preparation. XXXI. The effect of the variations in photometric passbands on photometric-redshift accuracy
• Euclid: Identifying the reddest high-redshift galaxies in the Euclid Deep Fields with gradient-boosted trees
• KiDS-Legacy: Angular galaxy clustering from deep surveys with complex selection effects
• The sensitivity of GPz estimates of photo-z posterior PDFs to realistically complex training set imperfections
• Euclid preparation. Simulations and nonlinearities beyond $\Lambda$CDM. 1. Numerical methods and validation
• Euclid preparation: Determining the weak lensing mass accuracy and precision for galaxy clusters
• Identification of single spectral lines in large spectroscopic surveys using UMLAUT: an Unsupervised Machine Learning Algorithm based on Unbiased Topology
• Euclid: Photometric redshift calibration with the clustering redshifts technique
• Accelerating the standard siren method: Improved constraints on modified gravitational-wave propagation with future data
• Identifying type II quasars at intermediate redshift with few-shot learning photometric classification
• Dark Energy Survey Deep Field photometric redshift performance and training incompleteness assessment
• Dark Energy Survey Year 3 Results: Deep Field Optical + Near-Infrared Images and Catalogue
• CLAP. I. Resolving miscalibration for deep learning-based galaxy photometric redshift estimation
• Euclid: Photometric redshift calibration with self-organising maps
• Effects of Environment on the Size Evolution of Quiescent Galaxies: Comparing Galaxies in Clusters and in the Field at Two Rest-frame Wavelengths
• Euclid: Testing photometric selection of emission-line galaxy targets
• Testing extensions to LCDM on small scales with forthcoming cosmic shear surveys
• Optical Identification of Galaxy Clusters among SRG/eROSITA X-ray Sources Based on Photometric Redshift Estimates for Galaxies
• Euclid preparation. Estimating galaxy physical properties using CatBoost chained regressors with attention
• Dark Energy Survey Year 3 Results: Galaxy mock catalogs for BAO analysis
• Euclid Preparation: XIV. The Complete Calibration of the Color-Redshift Relation (C3R2) Survey: Data Release 3
• 6x2pt: Forecasting gains from joint weak lensing and galaxy clustering analyses with spectroscopic-photometric galaxy cross-correlations
• ULISSE: Determination of star-formation rate and stellar mass based on the one-shot galaxy imaging technique
• TOPz: Photometric redshifts using template fitting applied to the GAMA survey
• Euclid: Optimising tomographic redshift binning for 3$\times$2pt power spectrum constraints on dark energy