Photometric selection and redshifts for quasars in the Kilo-Degree Survey Data Release 4

Abstract

We present a catalog of quasars and corresponding redshifts in the Kilo-Degree Survey (KiDS) Data Release 4. We trained machine learning (ML) models, using optical ugri and near-infrared ZYJHK_s bands, on objects known from Sloan Digital Sky Survey (SDSS) spectroscopy. We define inference subsets from the 45 million objects of the KiDS photometric data limited to 9-band detections. We show that projections of the high-dimensional feature space can be successfully used to investigate the estimations. The model creation employs two test subsets: randomly selected and the faintest objects, which allows to fit the bias versus variance trade-off. We tested three ML models: random forest (RF), XGBoost (XGB), and artificial neural network (ANN). We find that XGB is the most robust model for classification, while ANN performs the best for combined classification and redshift. The inference results are tested using number counts, Gaia parallaxes, and other quasar catalogs. Based on these tests, we derived the minimum classification probability which provides the best purity versus completeness trade-off: p(QSO_cand) > 0.9 for r < 22 and p(QSO_cand) > 0.98 for 22 < r < 23.5. We find 158,000 quasar candidates in the safe inference subset (r < 22) and an additional 185,000 candidates in the reliable extrapolation regime (22 < r < 23.5). Test-data purity equals 97% and completeness is 94%; the latter drops by 3% in the extrapolation to data fainter by one magnitude than the training set. The photometric redshifts were modeled with Gaussian uncertainties. The redshift error (mean and scatter) equals 0.01 +/- 0.1 in the safe subset and -0.0004 +/- 0.2 in the extrapolation, in a redshift range of 0.14 < z < 3.63. Our success of the extrapolation challenges the way that models are optimized and applied at the faint data end. The catalog is ready for cosmology and active galactic nucleus (AGN) studies.

arXiv commentWe publicly release the catalog at kids.strw.leidenuniv.nl/DR4/quasarcatalog.php , and the code at github.com/snakoneczny/kids-quasars

References in corpus (80)

• Scikit-learn: Machine Learning in Python
• The Sloan Digital Sky Survey: Technical Summary
• Gaia Data Release 2. Summary of the contents and survey properties
• The Wide-field Infrared Survey Explorer (WISE): Mission Description and Initial On-orbit Performance
• Nine-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Cosmological Parameter Results
• Coevolution (Or Not) of Supermassive Black Holes and Host Galaxies
• The Host Galaxies of AGN
• LSST: from Science Drivers to Reference Design and Anticipated Data Products
• Gaia Data Release 2: The astrometric solution
• The DESI Experiment Part I: Science,Targeting, and Survey Design
• Bayesian photometric redshift estimation
• Spectroscopic Target Selection in the Sloan Digital Sky Survey: The Quasar Sample
• Mid-Infrared Selection of AGN with the Wide-Field Infrared Survey Explorer. I. Characterizing WISE-Selected AGN in COSMOS
• KiDS-1000 Cosmology: Cosmic shear constraints and comparison between two point statistics
• KiDS-1000 Cosmology: Multi-probe weak gravitational lensing and spectroscopic galaxy clustering constraints
• The Fourteenth Data Release of the Sloan Digital Sky Survey: First Spectroscopic Data from the extended Baryon Oscillation Spectroscopic Survey and from the second phase of the Apache Point Observatory Galactic Evolution Experiment
• The 2dF QSO Redshift Survey - XII. The spectroscopic catalogue and luminosity function
• The Sloan Digital Sky Survey Quasar Catalog: Sixteenth Data Release
• The dust covering factor in active galactic nuclei
• Gravitational Lensing Analysis of the Kilo Degree Survey
• Photometric redshift and classification for the XMM-COSMOS sources
• KiDS+VIKING-450: Cosmic shear tomography with optical+infrared data
• Efficient Photometric Selection of Quasars from the Sloan Digital Sky Survey: II. ~1,000,000 Quasars from Data Release Six
• The fourth data release of the Kilo-Degree Survey: ugri imaging and nine-band optical-IR photometry over 1000 square degrees
• The first and second data releases of the Kilo-Degree Survey
• X-CIGALE: fitting AGN/galaxy SEDs from X-ray to infrared
• The Cosmic BPT Diagram: Confronting Theory with Observations
• Dissecting Photometric redshift for Active Galactic Nuclei using XMM- and Chandra-COSMOS samples
• Constraining the properties of AGN host galaxies with Spectral Energy Distribution modeling
• Detection of Cosmic Magnification with the Sloan Digital Sky Survey
• KiDS+GAMA: Cosmology constraints from a joint analysis of cosmic shear, galaxy-galaxy lensing and angular clustering
• The WISE AGN Catalog
• The third data release of the Kilo-Degree Survey and associated data products
• Efficient Photometric Selection of Quasars from the Sloan Digital Sky Survey: 100,000 z<3 Quasars from Data Release One
• Think Outside the Color Box: Probabilistic Target Selection and the SDSS-XDQSO Quasar Targeting Catalog
• KiDS-450: Testing extensions to the standard cosmological model
• Identification of 1.4 Million AGNs in the Mid-Infrared using WISE Data
• Clustering of intermediate redshift quasars using the final SDSS III-BOSS sample
• Photometric redshifts and quasar probabilities from a single, data-driven generative model
• The 2dF-SDSS LRG and QSO Survey: The spectroscopic QSO catalogue
• AGNfitter: A Bayesian MCMC approach to fitting spectral energy distributions of AGN
• Clustering of quasars in SDSS-IV eBOSS : study of potential systematics and bias determination
• SDSS quasars in the WISE preliminary data release and quasar candidate selection with optical/infrared colors
• The Extended Baryon Oscillation Spectroscopic Survey: Variability Selection and Quasar Luminosity Function
• Luminous K-band Selected Quasars from UKIDSS
• Morpheus: A Deep Learning Framework For Pixel-Level Analysis of Astronomical Image Data
• First discoveries of z~6 quasars with the Kilo Degree Survey and VISTA Kilo-Degree Infrared Galaxy survey
• Photometric redshifts for Quasars in multi band Surveys
• Reliable Identifications of AGN from the WISE, 2MASS and Rosat all-sky surveys
• The KX method for producing K-band flux-limited samples of quasars
• Identifying galaxies, quasars, and stars with machine learning: A new catalogue of classifications for 111 million SDSS sources without spectra
• No new cosmological concordance with massive sterile neutrinos
• Eight-Dimensional Mid-Infrared/Optical Bayesian Quasar Selection
• An Updated Tomographic Analysis of the Integrated Sachs-Wolfe Effect and implications for Dark Energy
• The Angular Clustering of Infrared-Selected Obscured and Unobscured Quasars
• Catalogues of Active Galactic Nuclei From Gaia and unWISE Data
• GaaP: PSF- and aperture-matched photometry using shapelets
• KiDS+VIKING-450: Improved cosmological parameter constraints from redshift calibration with self-organising maps
• Deep learning Approach for Classifying, Detecting and Predicting Photometric Redshifts of Quasars in the Sloan Digital Sky Survey Stripe 82
• Bayesian High-Redshift Quasar Classification from Optical and Mid-IR Photometry
• Quasar Probabilities and Redshifts from WISE mid-IR through GALEX UV Photometry
• Sloan Digital Sky Survey III Photometric Quasar Clustering: Probing the Initial Conditions of the Universe using the Largest Volume
• Unsupervised star, galaxy, qso classification: Application of HDBSCAN
• Automated physical classification in the SDSS DR10. A catalogue of candidate Quasars
• CPz: Classification-aided photometric-redshift estimation
• KiDS-SQuaD II: Machine learning selection of bright extragalactic objects to search for new gravitationally lensed quasars
• KiDS-SQuaD: The KiDS Strongly lensed Quasar Detection project
• The characteristic halo masses of half-a-million WISE-selected quasars
• The XXL Survey: VI. The 1000 brightest X-ray point sources
• Updated measurements of the dark matter halo masses of obscured quasars with improved WISE and Planck data
• Photometric selection and redshifts for quasars in the Kilo-Degree Survey Data Release 4
• Catalog of quasars from the Kilo-Degree Survey Data Release 3
• Return of the features. Efficient feature selection and interpretation for photometric redshifts
• Measurement of the thermal Sunyaev-Zel'dovich effect around cosmic voids
• Quasar Photometric Redshifts and Candidate Selection: A New Algorithm Based on Optical and Mid-Infrared Photometric Data
• Towards automatic classification of all WISE sources
• Tomographic imaging of the Fermi-LAT gamma-ray sky through cross-correlations: A wider and deeper look
• Photometric Classification of quasars from RCS-2 using Random Forest
• A quasar hiding behind two dusty absorbers. Quantifying the selection bias of metal-rich, damped Lyman-alpha absorption systems
• QSO photometric redshifts from SDSS, WISE and GALEX colours

Cited by in corpus (24)

• Bright galaxy sample in the Kilo-Degree Survey Data Release 4: selection, photometric redshifts, and physical properties
• The fifth data release of the Kilo Degree Survey: Multi-epoch optical/NIR imaging covering wide and legacy-calibration fields
• Photometric redshift-aided classification using ensemble learning
• Photometric selection and redshifts for quasars in the Kilo-Degree Survey Data Release 4
• Photometric Redshifts from SDSS Images with an Interpretable Deep Capsule Network
• Random Forests as a viable method to select and discover high redshift quasars
• CatNorth: An Improved Gaia DR3 Quasar Candidate Catalog with Pan-STARRS1 and CatWISE
• Predicting the redshift of gamma-ray loud AGNs using supervised machine learning
• Predicting the redshift of gamma-ray loud AGNs using Supervised Machine Learning: Part 2
• The miniJPAS survey quasar selection II: Machine learning classification with photometric measurements and uncertainties
• Wide Area VISTA Extra-galactic Survey (WAVES): Unsupervised star-galaxy separation on the WAVES-Wide photometric input catalogue using UMAP and $\mathrm{HDBSCAN}$
• Active galactic nuclei catalog from the AKARI NEP Wide field
• The probabilistic random forest applied to the QUBRICS survey: improving the selection of high-redshift quasars with synthetic data
• Semi-supervised classification of stars, galaxies and quasars using K-means and random-forest approaches
• The Quasar Catalogue for S-PLUS DR4 (QuCatS) and the estimation of photometric redshifts
• Redshifts of radio sources in the Million Quasars Catalogue from machine learning
• Morpho-Photometric Classification of KiDS DR5 Sources Based on Neural Networks: A Comprehensive Star-Quasar-Galaxy Catalog
• Applying machine learning to Galactic Archaeology: how well can we recover the origin of stars in Milky Way-like galaxies?
• Exploring the Dependence of Gas Cooling and Heating Functions on the Incident Radiation Field with Machine Learning
• Automated algorithms to build Active Galactic Nuclei classifiers
• Photometric classification of QSOs from ALHAMBRA survey using random forest
• A Morphological Model to Separate Resolved-Unresolved Sources in the DESI Legacy Surveys: Application in the LS4 Alert Stream
• Photometric redshifts for quasars from WISE-PS1-STRM
• 4MOST ChANGES: Catalog of high-redshift quasar candidates (4.5 < $z$ < 7) selected with SED fitting