METAPHOR: A machine learning based method for the probability density estimation of photometric redshifts
arXiv:1611.02162 · doi:10.1093/mnras/stw2930
Abstract
A variety of fundamental astrophysical science topics require the determination of very accurate photometric redshifts (photo-z's). A wide plethora of methods have been developed, based either on template models fitting or on empirical explorations of the photometric parameter space. Machine learning based techniques are not explicitly dependent on the physical priors and able to produce accurate photo-z estimations within the photometric ranges derived from the spectroscopic training set. These estimates, however, are not easy to characterize in terms of a photo-z Probability Density Function (PDF), due to the fact that the analytical relation mapping the photometric parameters onto the redshift space is virtually unknown. We present METAPHOR (Machine-learning Estimation Tool for Accurate PHOtometric Redshifts), a method designed to provide a reliable PDF of the error distribution for empirical techniques. The method is implemented as a modular workflow, whose internal engine for photo-z estimation makes use of the MLPQNA neural network (Multi Layer Perceptron with Quasi Newton learning rule), with the possibility to easily replace the specific machine learning model chosen to predict photo-z's. We present a summary of results on SDSS-DR9 galaxy data, used also to perform a direct comparison with PDF's obtained by the Le Phare SED template fitting. We show that METAPHOR is capable to estimate the precision and reliability of photometric redshifts obtained with three different self-adaptive techniques, i.e. MLPQNA, Random Forest and the standard K-Nearest Neighbors models.
Accepted from MNRAS, 17 pages, 16 figures
References in corpus (35)
- Scikit-learn: Machine Learning in Python
- Stellar population synthesis at the resolution of 2003
- The Sloan Digital Sky Survey: Technical Summary
- Measuring Reddening with SDSS Stellar Spectra and Recalibrating SFD
- EAZY: A Fast, Public Photometric Redshift Code
- Accurate photometric redshifts for the CFHT Legacy Survey calibrated using the VIMOS VLT Deep Survey
- COSMOS Photometric Redshifts with 30-bands for 2-deg2
- Measuring and Modelling the Redshift Evolution of Clustering: the Hubble Deep Field North
- Spectral Energy Distributions of Hard X-ray selected AGNs in the XMDS Survey
- Slicing Through Multicolor Space: Galaxy Redshifts From Broadband Photometry
- The first and second data releases of the Kilo-Degree Survey
- Mapping the Galaxy Color-Redshift Relation: Optimal Photometric Redshift Calibration Strategies for Cosmology Surveys
- ANNz2 - photometric redshift and probability distribution function estimation using machine learning
- Photometric Redshift with Bayesian Priors on Physical Properties of Galaxies
- Precision photometric redshift calibration for galaxy-galaxy weak lensing
- SOMz: photometric redshift PDFs with self organizing maps and random atlas
- Spectroscopic Needs for Imaging Dark Energy Experiments: Photometric Redshift Training and Calibration
- Photometric redshifts for Quasars in multi band Surveys
- CLASH-VLT: Environment-driven evolution of galaxies in the z=0.209 cluster Abell 209
- Using neural networks to estimate redshift distributions. An application to CFHTLenS
- A catalogue of photometric redshifts for the SDSS-DR9 galaxies
- Feature importance for machine learning redshifts applied to SDSS galaxies
- Exhausting the Information: Novel Bayesian Combination of Photometric Redshift PDFs
- Photometric classification of emission line galaxies with Machine Learning methods
- Machine Learning based photometric redshifts for the KiDS ESO DR2 galaxies
- Overconfidence in Photometric Redshift Estimation
- Towards a census of super-compact massive galaxies in the Kilo Degree Survey
- Size of spectroscopic calibration samples for cosmic shear photometric redshifts
- Photometric redshift estimation based on data mining with PhotoRApToR
- A cooperative approach among methods for photometric redshifts estimation: an application to KiDS data
- Photometric redshifts with Quasi Newton Algorithm (MLPQNA). Results in the PHAT1 contest
- Sub-Megaparsec Individual Photometric Redshift Estimation from Cosmic Web Constraints
- Circumbinary Ring, Circumstellar disks and accretion in the binary system UY Aurigae
- The detection of globular clusters in galaxies as a data mining problem
- The Properties of the Heterogeneous Shakhbazyan Groups of Galaxies in the SDSS
Cited by in corpus (48)
- The third data release of the Kilo-Degree Survey and associated data products
- The Strong Gravitational Lens Finding Challenge
- Classifying Radio Galaxies with Convolutional Neural Network
- Surveying the reach and maturity of machine learning and artificial intelligence in astronomy
- Euclid preparation: X. The Euclid photometric-redshift challenge
- Galaxy clustering in the DESI Legacy Survey and its imprint on the CMB
- Identifying Strong Lenses with Unsupervised Machine Learning using Convolutional Autoencoder
- Evaluation of probabilistic photometric redshift estimation approaches for The Rubin Observatory Legacy Survey of Space and Time (LSST)
- Photometric redshifts for the Kilo-Degree Survey. Machine-learning analysis with artificial neural networks
- Photometric Redshift Estimation with a Convolutional Neural Network: NetZ
- The Fornax Deep Survey with VST. IX. The catalog of sources in the FDS area, with an example study for globular clusters and background galaxies
- Deep Learning for Strong Lensing Search: Tests of the Convolutional Neural Networks and New Candidates from KiDS DR3
- Star Formation Rates for photometric samples of galaxies using machine learning methods
- Photometric Redshifts from SDSS Images with an Interpretable Deep Capsule Network
- Improving the reliability of photometric redshift with machine learning
- Photometric Redshift Estimation of BASS DR3 Quasars by Machine Learning
- Approximating photo- PDFs for large surveys
- Photometric redshifts with machine learning, lights and shadows on a complex data science use case
- Assessing the photometric redshift precision of the S-PLUS survey: the Stripe-82 as a test-case
- Statistical analysis of probability density functions for photometric redshifts through the KiDS-ESO-DR3 galaxies
- Photometric redshifts for X-ray-selected active galactic nuclei in the eROSITA era
- A Comparison of Photometric Redshift Techniques for Large Radio Surveys
- Machine Learning Based Real Bogus System for HSC-SSP Moving Object Detecting Pipeline
- Foreword to the Focus Issue on Machine Learning in Astronomy and Astrophysics
- Augmenting machine learning photometric redshifts with Gaussian mixture models
- J-PAS: Measuring emission lines with artificial neural networks
- PhotoRedshift-MML: a multimodal machine learning method for estimating photometric redshifts of quasars
- Hybrid photometric redshifts for sources in the COSMOS and XMM-LSS fields
- Preliminary results of using k-Nearest Neighbours Regression to estimate the redshift of radio selected datasets
- Estimating Photometric Redshifts for X-ray sources in the X-ATLAS field, using machine-learning techniques
- Photometric redshifts for the Pan-STARRS1 survey
- Estimation of Photometric Redshifts. I. Machine Learning Inference for Pan-STARRS1 Galaxies Using Neural Networks
- Machine learning synthetic spectra for probabilistic redshift estimation: SYTH-Z
- The miniJPAS survey quasar selection III: Classification with artificial neural networks and hybridisation
- PICZL: Image-based Photometric Redshifts for AGN
- Data Deluge in Astrophysics: Photometric Redshifts as a Template Use Case
- The VOICE Survey : VST Optical Imaging of the CDFS and ES1 Fields
- Estimation of Photometric Redshifts. II. Identification of Out-of-Distribution Data with Neural Networks
- The effect of emission lines on the performance of photometric redshift estimation algorithms
- Rejection criteria based on outliers in the KiDS photometric redshifts and PDF distributions derived by machine learning
- CLAP. I. Resolving miscalibration for deep learning-based galaxy photometric redshift estimation
- Pulsar B1237+25 Aberration/Retardation Analysis from Decimeter to Decameter Wavelength: Challenge to "Radius-to-Frequency Mapping"
- Navigating AGN variability with self-organizing maps
- Lenses In VoicE (LIVE): Searching for strong gravitational lenses in the VOICE@VST survey using Convolutional Neural Networks
- ULISSE: Determination of star-formation rate and stellar mass based on the one-shot galaxy imaging technique
- Cooperative photometric redshift estimation
- EMU/GAMA: A new approach to characterising radio luminosity functions
- Photometric Redshift Estimation Using Scaled Ensemble Learning