Improving the reliability of photometric redshift with machine learning

Abstract

In order to answer the open questions of modern cosmology and galaxy evolution theory, robust algorithms for calculating photometric redshifts (photo-z) for very large samples of galaxies are needed. Correct estimation of the various photo-z algorithms' performance requires attention to both the performance metrics and the data used for the estimation. In this work, we use the supervised machine learning algorithm MLPQNA to calculate photometric redshifts for the galaxies in the COSMOS2015 catalogue and the unsupervised Self-Organizing Maps (SOM) to determine the reliability of the resulting estimates. We find that for spec-z<1.2, photo-z predictions are on the same level of quality as SED fitting photo-z. We show that the SOM successfully detects unreliable spec-z that cause biases in the estimation of the photo-z algorithms' performance. Additionally, we use SOM to select the objects with reliable photo-z predictions. Our cleaning procedures allow to extract the subset of objects for which the quality of the final photo-z catalogs is improved by a factor of two, compared to the overall statistics.

arXiv comment26 pages, 15 figures, accepted for publication in MNRAS

References in corpus (52)

• LSST: from Science Drivers to Reference Design and Anticipated Data Products
• The Cosmic Evolution Survey (COSMOS) -- Overview
• EAZY: A Fast, Public Photometric Redshift Code
• Accurate photometric redshifts for the CFHT Legacy Survey calibrated using the VIMOS VLT Deep Survey
• COSMOS Photometric Redshifts with 30-bands for 2-deg2
• Bayesian photometric redshift estimation
• The COSMOS2015 Catalog: Exploring the 1<z<6 Universe with half a million galaxies
• Measuring and Modelling the Redshift Evolution of Clustering: the Hubble Deep Field North
• UltraVISTA: a new ultra-deep near-infrared survey in COSMOS
• The First Release COSMOS Optical and Near-IR Data and Catalog
• ANNz: estimating photometric redshifts using artificial neural networks
• The VIMOS VLT Deep Survey - First epoch VVDS-Deep survey: 11564 spectra with 17.5<=IAB<=24, and the redshift distribution over 0< z <=5
• Slicing Through Multicolor Space: Galaxy Redshifts From Broadband Photometry
• Observations of the MIssing Baryons in the warm-hot intergalactic medium
• Calibrating Redshift Distributions Beyond Spectroscopic Limits with Cross-Correlations
• TPZ : Photometric redshift PDFs and ancillary information by using prediction trees and random forests
• The Chandra COSMOS Survey: III. Optical and Infrared Identification of X-ray Point Sources
• The DEIMOS 10k spectroscopic survey catalog of the COSMOS field
• Mapping the Galaxy Color-Redshift Relation: Optimal Photometric Redshift Calibration Strategies for Cosmology Surveys
• ANNz2 - photometric redshift and probability distribution function estimation using machine learning
• Photometric redshifts from SDSS images using a Convolutional Neural Network
• CLASH-VLT: The mass, velocity-anisotropy, and pseudo-phase-space density profiles of the z=0.44 galaxy cluster MACS 1206.2-0847
• Photometric redshifts for the SDSS Data Release 12
• Redshift distributions of galaxies in the DES Science Verification shear catalogue and implications for weak lensing
• Machine Learning in Astronomy: a practical overview
• The Complete Calibration of the Color-Redshift Relation (C3R2) Survey: Survey Overview and Data Release 1
• ArborZ: Photometric Redshifts Using Boosted Decision Trees
• KiDS+VIKING-450: A new combined optical & near-IR dataset for cosmology and astrophysics
• SOMz: photometric redshift PDFs with self organizing maps and random atlas
• Euclid preparation: X. The Euclid photometric-redshift challenge
• The Redshift Distribution and Luminosity Functions of Galaxies in the Hubble Deep Field
• Phenotypic redshifts with self-organizing maps: A novel method to characterize redshift distributions of source galaxies for weak lensing
• Robust Machine Learning Applied to Astronomical Datasets III: Probabilistic Photometric Redshifts for Galaxies and Quasars in the SDSS and GALEX
• Photometric redshifts for Quasars in multi band Surveys
• Unsupervised self-organised mapping: a versatile empirical tool for object selection, classification and redshift estimation in large surveys
• Evaluation of probabilistic photometric redshift estimation approaches for The Rubin Observatory Legacy Survey of Space and Time (LSST)
• METAPHOR: A machine learning based method for the probability density estimation of photometric redshifts
• Photometric redshifts for the Kilo-Degree Survey. Machine-learning analysis with artificial neural networks
• Scientific Synergy Between LSST and Euclid
• The PAU Survey: Early demonstration of photometric redshift performance in the COSMOS field
• A catalogue of photometric redshifts for the SDSS-DR9 galaxies
• Photometric redshifts for the next generation of deep radio continuum surveys - II. Gaussian processes and hybrid estimates
• Machine Learning based photometric redshifts for the KiDS ESO DR2 galaxies
• Photometric redshift estimation based on data mining with PhotoRApToR
• A cooperative approach among methods for photometric redshifts estimation: an application to KiDS data
• Photometric redshifts with Quasi Newton Algorithm (MLPQNA). Results in the PHAT1 contest
• The PAU Survey: Photometric redshifts using transfer learning from simulations
• Return of the features. Efficient feature selection and interpretation for photometric redshifts
• Can Self-Organizing Maps accurately predict photometric redshifts?
• Photometric redshifts for X-ray-selected active galactic nuclei in the eROSITA era
• A Comparison of Photometric Redshift Techniques for Large Radio Surveys
• Of Genes and Machines: application of a combination of machine learning tools to astronomy datasets

Cited by in corpus (16)

• Photometric Redshifts from SDSS Images with an Interpretable Deep Capsule Network
• Photometric redshifts with machine learning, lights and shadows on a complex data science use case
• Euclid preparation: XXII. Selection of Quiescent Galaxies from Mock Photometry using Machine Learning
• PhotoRedshift-MML: a multimodal machine learning method for estimating photometric redshifts of quasars
• Improving machine learning-derived photometric redshifts and physical property estimates using unlabelled observations
• ULISSE: A Tool for One-shot Sky Exploration and its Application to Active Galactic Nuclei Detection
• VST-GAME: Galaxy Assembly as a function of Mass and Environment with VST. Photometric assessment and density field of MACSJ0416
• Euclid preparation. LI. Forecasting the recovery of galaxy physical properties and their relations with template-fitting and machine-learning methods
• Enhancing Photometric Redshift Catalogs Through Color-Space Analysis: Application to KiDS-Bright Galaxies
• DULAG: A DUal and Lensed AGN candidate catalog with GMP method
• Identifying type II quasars at intermediate redshift with few-shot learning photometric classification
• Machine learning applications in astrophysics: Photometric redshift estimation
• Euclid preparation. Estimating galaxy physical properties using CatBoost chained regressors with attention
• ULISSE: Determination of star-formation rate and stellar mass based on the one-shot galaxy imaging technique
• A Quantum Genetic Algorithm with application to Cosmological Parameters Estimation
• TOPz: Photometric redshifts using template fitting applied to the GAMA survey