Photometric redshifts for Quasars in multi band Surveys
arXiv:1305.5641 · doi:10.1088/0004-637X/772/2/140
Abstract
MLPQNA stands for Multi Layer Perceptron with Quasi Newton Algorithm and it is a machine learning method which can be used to cope with regression and classification problems on complex and massive data sets. In this paper we give the formal description of the method and present the results of its application to the evaluation of photometric redshifts for quasars. The data set used for the experiment was obtained by merging four different surveys (SDSS, GALEX, UKIDSS and WISE), thus covering a wide range of wavelengths from the UV to the mid-infrared. The method is able i) to achieve a very high accuracy; ii) to drastically reduce the number of outliers and catastrophic objects; iii) to discriminate among parameters (or features) on the basis of their significance, so that the number of features used for training and analysis can be optimized in order to reduce both the computational demands and the effects of degeneracy. The best experiment, which makes use of a selected combination of parameters drawn from the four surveys, leads, in terms of DeltaZnorm (i.e. (zspec-zphot)/(1+zspec)), to an average of DeltaZnorm = 0.004, a standard deviation sigma = 0.069 and a Median Absolute Deviation MAD = 0.02 over the whole redshift range (i.e. zspec <= 3.6), defined by the 4-survey cross-matched spectroscopic sample. The fraction of catastrophic outliers, i.e. of objects with photo-z deviating more than 2sigma from the spectroscopic value is < 3%, leading to a sigma = 0.035 after their removal, over the same redshift range. The method is made available to the community through the DAMEWARE web application.
arXiv comment38 pages, Submitted to ApJ in February 2013; Accepted by ApJ in May 2013
References in corpus (27)
- The Wide-field Infrared Survey Explorer (WISE): Mission Description and Initial On-orbit Performance
- The Seventh Data Release of the Sloan Digital Sky Survey
- A survey of cross-validation procedures for model selection
- The UKIRT Infrared Deep Sky Survey (UKIDSS)
- The Galaxy Evolution Explorer: A Space Ultraviolet Survey Mission
- The Eighth Data Release of the Sloan Digital Sky Survey: First Data from SDSS-III
- The Sloan Digital Sky Survey Quasar Catalog V. Seventh Data Release
- ANNz: estimating photometric redshifts using artificial neural networks
- A catalogue of the Chandra Deep Field South with multi-colour classification and photometric redshifts from COMBO-17
- Efficient Photometric Selection of Quasars from the Sloan Digital Sky Survey: II. ~1,000,000 Quasars from Data Release Six
- Binary Quasars in the Sloan Digital Sky Survey: Evidence for Excess Clustering on Small Scales
- PHAT: PHoto-z Accuracy Testing
- Detection of Cosmic Magnification with the Sloan Digital Sky Survey
- Colors of 2625 Quasars at 0<z<5 Measured in the Sloan Digital Sky Survey Photometric System
- First Measurement of the Clustering Evolution of Photometrically-Classified Quasars
- Photometric Redshifts of Galaxies in COSMOS
- Photometric redshifts and quasar probabilities from a single, data-driven generative model
- Photometric Redshifts of Quasars
- Robust Machine Learning Applied to Astronomical Datasets III: Probabilistic Photometric Redshifts for Galaxies and Quasars in the SDSS and GALEX
- Photometric redshifts from reconstructed QSO templates
- On the compared accuracy and reliability of spectroscopic and photometric redshift measurements
- Quasar candidates selection in the Virtual Observatory era
- Mining the SDSS archive. I. Photometric redshifts in the nearby universe
- Astroinformatics of galaxies and quasars: a new general method for photometric redshifts estimation
- Photometric redshifts with Quasi Newton Algorithm (MLPQNA). Results in the PHAT1 contest
- The detection of globular clusters in galaxies as a data mining problem
- An Empirical Limit on Extremely High Redshift Galaxies
Cited by in corpus (70)
- The first and second data releases of the Kilo-Degree Survey
- 2MASS Photometric Redshift catalog: a comprehensive three-dimensional census of the whole sky
- The third data release of the Kilo-Degree Survey and associated data products
- Photometric redshift estimation via deep learning
- Surveying the reach and maturity of machine learning and artificial intelligence in astronomy
- Euclid preparation: X. The Euclid photometric-redshift challenge
- An automatic taxonomy of galaxy morphology using unsupervised machine learning
- Intra Cluster Light properties in the CLASH-VLT cluster MACS J1206.2-0847
- CLASH-VLT: Environment-driven evolution of galaxies in the z=0.209 cluster Abell 209
- Photometric redshifts for the next generation of deep radio continuum surveys - I: Template fitting
- Photometric redshifts for the Kilo-Degree Survey. Machine-learning analysis with artificial neural networks
- METAPHOR: A machine learning based method for the probability density estimation of photometric redshifts
- AGN Populations in Large Volume X-ray Surveys: Photometric Redshifts and Population Types found in the Stripe 82X Survey
- Evolution of galaxy size--stellar mass relation from the Kilo Degree Survey
- A catalogue of photometric redshifts for the SDSS-DR9 galaxies
- Feature importance for machine learning redshifts applied to SDSS galaxies
- CLASH-VLT: The stellar mass function and stellar mass density profile of the z=0.44 cluster of galaxies MACS J1206.2-0847
- Automated physical classification in the SDSS DR10. A catalogue of candidate Quasars
- Photometric classification of emission line galaxies with Machine Learning methods
- Machine Learning based photometric redshifts for the KiDS ESO DR2 galaxies
- Towards a census of super-compact massive galaxies in the Kilo Degree Survey
- Photometric redshift estimation based on data mining with PhotoRApToR
- A cooperative approach among methods for photometric redshifts estimation: an application to KiDS data
- Photometric selection and redshifts for quasars in the Kilo-Degree Survey Data Release 4
- The first sample of spectroscopically confirmed ultra-compact massive galaxies in the Kilo Degree Survey
- Star Formation Rates for photometric samples of galaxies using machine learning methods
- Galaxy pre-processing in substructures around z0.4 galaxy clusters
- Finding Quasars behind the Galactic Plane. I. Candidate Selections with Transfer Learning
- Quasar Photometric Redshifts and Candidate Selection: A New Algorithm Based on Optical and Mid-Infrared Photometric Data
- The search for galaxy cluster members with deep learning of panchromatic HST imaging and extensive spectroscopy
- Improving the reliability of photometric redshift with machine learning
- Photometric Redshift Estimation of BASS DR3 Quasars by Machine Learning
- Photometric redshifts with machine learning, lights and shadows on a complex data science use case
- Building the largest spectroscopic sample of ultra-compact massive galaxies with the Kilo Degree Survey
- Statistical analysis of probability density functions for photometric redshifts through the KiDS-ESO-DR3 galaxies
- Photometric redshifts for X-ray-selected active galactic nuclei in the eROSITA era
- Euclid preparation: XXII. Selection of Quiescent Galaxies from Mock Photometry using Machine Learning
- Automatic Survey-Invariant Variable Star Classification
- A Comparison of Photometric Redshift Techniques for Large Radio Surveys
- QSO photometric redshifts using machine learning and neural networks
- Searching for AGN and Pulsar Candidates in 4FGL Unassociated Sources Using Machine Learning
- Preliminary results of using k-Nearest Neighbours Regression to estimate the redshift of radio selected datasets
- DAMEWARE: A web cyberinfrastructure for astrophysical data mining
- PhotoRedshift-MML: a multimodal machine learning method for estimating photometric redshifts of quasars
- Photometric Redshift Estimation for Quasars by Integration of KNN and SVM
- Photometric redshift estimation of galaxies in the DESI Legacy Imaging Surveys
- Predicting the redshift of gamma-ray loud AGNs using Supervised Machine Learning: Part 2
- Predicting the redshift of gamma-ray loud AGNs using supervised machine learning
- QSO photometric redshifts from SDSS, WISE and GALEX colours
- Photometric Redshift Estimation with Galaxy Morphology using Self-Organizing Maps
- GeneticKNN: A Weighted KNN Approach Supported by Genetic Algorithm for Photometric Redshift Estimation of Quasars
- On the Performance of Quasar Reverberation Mapping in the Era of Time-Domain Photometric Surveys
- Estimation of Photometric Redshifts. I. Machine Learning Inference for Pan-STARRS1 Galaxies Using Neural Networks
- Improving machine learning-derived photometric redshifts and physical property estimates using unlabelled observations
- ULISSE: A Tool for One-shot Sky Exploration and its Application to Active Galactic Nuclei Detection
- Data Deluge in Astrophysics: Photometric Redshifts as a Template Use Case
- Intervening or associated? Machine learning classification of redshifted H I 21-cm absorption
- Astroinformatics based search for globular clusters in the Fornax Deep Survey
- Euclid preparation. LI. Forecasting the recovery of galaxy physical properties and their relations with template-fitting and machine-learning methods
- Euclid preparation. LXVIII. Extracting physical parameters from galaxies with machine learning
- Fermi LAT AGN classification using supervised machine learning
- Quasar photometric redshifts from incomplete data using Deep Learning
- The Quasar Catalogue for S-PLUS DR4 (QuCatS) and the estimation of photometric redshifts
- Rejection criteria based on outliers in the KiDS photometric redshifts and PDF distributions derived by machine learning
- Redshifts of radio sources in the Million Quasars Catalogue from machine learning
- METAPHOR: Probability density estimation for machine learning based photometric redshifts
- Euclid preparation. Estimating galaxy physical properties using CatBoost chained regressors with attention
- ULISSE: Determination of star-formation rate and stellar mass based on the one-shot galaxy imaging technique
- Probability density estimation of photometric redshifts based on machine learning
- Cooperative photometric redshift estimation