Photometric redshifts and quasar probabilities from a single, data-driven generative model

Abstract

We describe a technique for simultaneously classifying and estimating the redshift of quasars. It can separate quasars from stars in arbitrary redshift ranges, estimate full posterior distribution functions for the redshift, and naturally incorporate flux uncertainties, missing data, and multi-wavelength photometry. We build models of quasars in flux-redshift space by applying the extreme deconvolution technique to estimate the underlying density. By integrating this density over redshift one can obtain quasar flux-densities in different redshift ranges. This approach allows for efficient, consistent, and fast classification and photometric redshift estimation. This is achieved by combining the speed obtained by choosing simple analytical forms as the basis of our density model with the flexibility of non-parametric models through the use of many simple components with many parameters. We show that this technique is competitive with the best photometric quasar classification techniques---which are limited to fixed, broad redshift ranges and high signal-to-noise ratio data---and with the best photometric redshift techniques when applied to broadband optical data. We demonstrate that the inclusion of UV and NIR data significantly improves photometric quasar--star separation and essentially resolves all of the redshift degeneracies for quasars inherent to the ugriz filter system, even when included data have a low signal-to-noise ratio. For quasars spectroscopically confirmed by the SDSS 84 and 97 percent of the objects with GALEX UV and UKIDSS NIR data have photometric redshifts within 0.1 and 0.3, respectively, of the spectroscopic redshift; this amounts to about a factor of three improvement over ugriz-only photometric redshifts. Our code to calculate quasar probabilities and redshift probability distributions is publicly available.

References in corpus (35)

• The UKIRT Infrared Deep Sky Survey (UKIDSS)
• The 2.5 m Telescope of the Sloan Digital Sky Survey
• SDSS-III: Massive Spectroscopic Surveys of the Distant Universe, the Milky Way Galaxy, and Extra-Solar Planetary Systems
• The Eighth Data Release of the Sloan Digital Sky Survey: First Data from SDSS-III
• An Observational Determination of the Bolometric Quasar Luminosity Function
• Modeling the Time Variability of SDSS Stripe 82 Quasars as a Damped Random Walk
• The Milky Way Tomography with SDSS: II. Stellar Metallicity
• The WFCAM Science Archive
• The UKIRT Wide Field Camera ZYJHK Photometric System: Calibration from 2MASS
• SDSS Standard Star Catalog for Stripe 82: the Dawn of Industrial 1% Optical Photometry
• The SDSS-III Baryon Oscillation Spectroscopic Survey: Quasar Target Selection for Data Release Nine
• Combined analysis of the integrated Sachs-Wolfe effect and cosmological implications
• The UKIRT Infrared Deep Sky Survey Early Data Release
• Think Outside the Color Box: Probabilistic Target Selection and the SDSS-XDQSO Quasar Targeting Catalog
• Clustering Analyses of 300,000 Photometrically Classified Quasars--I. Luminosity and Redshift Evolution in Quasar Bias
• A high redshift detection of the integrated Sachs-Wolfe effect
• Dark energy and curvature from a future baryonic acoustic oscillation survey using the Lyman-alpha forest
• Optimal Time-Series Selection of Quasars
• Quasars Probing Quasars II: The Anisotropic Clustering of Optically Thick Absorbers around Quasars
• The 2dF-SDSS LRG and QSO Survey: The spectroscopic QSO catalogue
• Catalogs of Hot White Dwarfs in the Milky Way from GALEX's Ultraviolet Sky Surveys. Constraining Stellar Evolution
• Clustering Analyses of 300,000 Photometrically Classified Quasars--II. The Excess on Very Small Scales
• Quasar Clustering at $25\kpch$ from a Complete Sample of Binaries
• Quasar Selection Based on Photometric Variability
• Variability selected high-redshift quasars on SDSS Stripe 82
• Robust Machine Learning Applied to Astronomical Datasets III: Probabilistic Photometric Redshifts for Galaxies and Quasars in the SDSS and GALEX
• On Estimating Lyman-alpha Forest Correlations between Multiple Sightlines
• Probabilistic selection of high-redshift quasars
• Mid-Infrared Variability from the Spitzer Deep, Wide-Field Survey
• The UV Properties of SDSS Selected Quasars
• GALEX observations of quasar variability in the ultraviolet
• Near Infrared Photometric properties of 130,000 Quasars: An SDSS-UKIDSS matched catalog
• The Optical and Near-Infrared Properties of 2837 Quasars in the UKIRT Infrared Deep Sky Survey (UKIDSS)
• Photometric Covariance in Multi-Band Surveys: Understanding the Photometric Error in the SDSS
• An Improved Photometric Calibration of the Sloan Digital Sky Survey Imaging Data

Cited by in corpus (98)

• The Eleventh and Twelfth Data Releases of the Sloan Digital Sky Survey: Final Data from SDSS-III
• SDSS-III: Massive Spectroscopic Surveys of the Distant Universe, the Milky Way Galaxy, and Extra-Solar Planetary Systems
• The Baryon Oscillation Spectroscopic Survey of SDSS-III
• Sloan Digital Sky Survey IV: Mapping the Milky Way, Nearby Galaxies, and the Distant Universe
• Baryon Acoustic Oscillations in the Lyα forest of BOSS DR11 quasars
• The SDSS-IV extended Baryon Oscillation Spectroscopic Survey: Overview and Early Data
• Cosmological implications of baryon acoustic oscillation (BAO) measurements
• Baryon Acoustic Oscillations in the Ly-α forest of BOSS quasars
• The Sloan Digital Sky Survey Quasar Catalog: Sixteenth Data Release
• The Sloan Digital Sky Survey Quasar Catalog: Fourteenth Data Release
• The Sloan Digital Sky Survey Quasar Catalog: twelfth data release
• The Sloan Digital Sky Survey quasar catalog: ninth data release
• The Quest for Dual and Binary Supermassive Black Holes: A Multi-Messenger View
• The Sloan Digital Sky Survey quasar catalog: tenth data release
• The WISE AGN Catalog
• The clustering of intermediate redshift quasars as measured by the Baryon Oscillation Spectroscopic Survey
• WISE photometry for 400 million SDSS sources
• The SDSS-IV extended Baryon Oscillation Spectroscopic Survey: Quasar Target Selection
• The Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: Large-scale Structure Catalogs for Cosmological Analysis
• Finding counterparts for All-sky X-ray surveys with Nway: a Bayesian algorithm for cross-matching multiple catalogues
• Mean Spectral Energy Distributions and Bolometric Corrections for Luminous Quasars
• Identification of 1.4 Million AGNs in the Mid-Infrared using WISE Data
• The clustering of the SDSS-IV extended Baryon Oscillation Spectroscopic Survey DR14 quasar sample: measurement of the growth rate of structure from the anisotropic correlation function between redshift 0.8 and 2.2
• The clustering of the SDSS-IV extended Baryon Oscillation Spectroscopic Survey DR14 quasar sample: structure growth rate measurement from the anisotropic quasar power spectrum in the redshift range $0.8<z<2.2$
• The Target-selection Pipeline for the Dark Energy Spectroscopic Instrument
• Quasars Probing Quasars VI. Excess HI Absorption Within One Proper Mpc of z~2 Quasars
• The Stellar Metallicity Distribution Function of the Galactic Halo from SDSS Photometry
• Clustering of quasars in SDSS-IV eBOSS : study of potential systematics and bias determination
• Constraints on primordial non-Gaussianity from 800,000 photometric quasars
• Quasars Probing Quasars VII. The Pinnacle of the Cool Circumgalactic Medium Surrounds Massive z~2 Galaxies
• Quasars Probing Quasars IV: Joint Constraints on the Circumgalactic Medium from Absorption and Emission
• The Atacama Cosmology Telescope: Cross-Correlation of CMB Lensing and Quasars
• Luminosity Function from dedicated SDSS-III and MMT data of quasars in 0.7<z<4.0 selected with a new approach
• The extended Baryon Oscillation Spectroscopic Survey (eBOSS): a cosmological forecast
• All-purpose, all-sky photometric redshifts for the Legacy Imaging Surveys Data Release 8
• Photometric redshifts for Quasars in multi band Surveys
• Photometric redshifts for the next generation of deep radio continuum surveys - I: Template fitting
• The clustering of the SDSS-IV extended Baryon Oscillation Spectroscopic Survey DR14 quasar sample: anisotropic clustering analysis in configuration-space
• unWISE tomography of Planck CMB lensing
• Multi-tracer extension of the halo model: probing quenching and conformity in eBOSS
• Quasars Probing Quasars VIII. The Physical Properties of the Cool Circumgalactic Medium Surrounding z ~ 2-3 Massive Galaxies Hosting Quasars
• Observational Requirements for Lyman-alpha Forest Tomographic Mapping of Large-Scale Structure at z ~ 2
• AGN Populations in Large Volume X-ray Surveys: Photometric Redshifts and Population Types found in the Stripe 82X Survey
• The Time Domain Spectroscopic Survey: Changing-Look Quasar Candidates from Multi-Epoch Spectroscopy in SDSS-IV
• Bayesian High-Redshift Quasar Classification from Optical and Mid-IR Photometry
• Dissecting the Gaseous Halos of z~2 Damped Ly$\alpha$ Systems with Close Quasar Pairs
• Sloan Digital Sky Survey III Photometric Quasar Clustering: Probing the Initial Conditions of the Universe using the Largest Volume
• Quasar Probabilities and Redshifts from WISE mid-IR through GALEX UV Photometry
• Exploiting the full potential of photometric quasar surveys: Optimal power spectra through blind mitigation of systematics
• Photometric redshifts for the next generation of deep radio continuum surveys - II. Gaussian processes and hybrid estimates
• A New Method to Directly Measure the Jeans Scale of the Intergalactic Medium Using Close Quasar Pairs
• Measurement of the small-scale structure of the intergalactic medium using close quasar pairs
• SDSS-IV eBOSS emission-line galaxy pilot survey
• Statistical Detection of the HeII Transverse Proximity Effect: Evidence for Sustained Quasar Activity for $>$25 Million Years
• Primordial non-Gaussianity from the Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey I: Catalogue Preparation and Systematic Mitigation
• A Search for Kilonovae in the Dark Energy Survey
• On the discovery of stars, quasars, and galaxies in the Southern Hemisphere with S-PLUS DR2
• The Extremely Luminous Quasar Survey (ELQS) in the SDSS footprint I.: Infrared Based Candidate Selection
• Photometric selection and redshifts for quasars in the Kilo-Degree Survey Data Release 4
• Replacing standard galaxy profiles with mixtures of Gaussians
• Catalog of quasars from the Kilo-Degree Survey Data Release 3
• Finding Quasars behind the Galactic Plane. I. Candidate Selections with Transfer Learning
• Finding the brightest cosmic beacons in the Southern Hemisphere
• Quasar Photometric Redshifts and Candidate Selection: A New Algorithm Based on Optical and Mid-Infrared Photometric Data
• EmpiriciSN: Re-sampling Observed Supernova/Host Galaxy Populations using an XD Gaussian Mixture Model
• Spectral Evolution in High Redshift Quasars from the Final BOSS Sample
• Estimating Photometric Redshifts of Quasars via K-nearest Neighbor Approach Based on Large Survey Databases
• Photometric redshifts with machine learning, lights and shadows on a complex data science use case
• A Study of Quasar Selection in the Dark Energy Survey Supernova fields
• Photometric redshifts for X-ray-selected active galactic nuclei in the eROSITA era
• Improving \textsl{Gaia} parallax precision with a data-driven model of stars
• Explicit Bayesian treatment of unknown foreground contaminations in galaxy surveys
• A Southern Photometric Quasar Catalog from the Dark Energy Survey Data Release 2
• Identification of BASS DR3 Sources as Stars, Galaxies and Quasars by XGBoost
• QSO photometric redshifts using machine learning and neural networks
• Sparse Representation of Photometric Redshift PDFs: Preparing for Petascale Astronomy
• The Time-Domain Spectroscopic Survey: Understanding the Optically Variable Sky with SEQUELS in SDSS-III
• Photometric Redshift Estimation for Quasars by Integration of KNN and SVM
• Quasars probing quasars X: The quasar pair spectral database
• QSO photometric redshifts from SDSS, WISE and GALEX colours
• Incorporating Measurement Error in Astronomical Object Classification
• Baryon Acoustic Oscillations in the projected cross-correlation function between the eBOSS DR16 quasars and photometric galaxies from the DESI Legacy Imaging Surveys
• GeneticKNN: A Weighted KNN Approach Supported by Genetic Algorithm for Photometric Redshift Estimation of Quasars
• Quasars at intermediate redshift are not special; but they are often satellites
• Host Dark Matter Halos of SDSS Red and Blue Quasars: No Significant Difference in Large-scale Environment
• Paving the Way for Euclid and JWST via Optimal Selection of High-z Quasars
• A Gaia DR2 search for dwarf galaxies towards Fermi-LAT sources: implications for annihilating dark matter
• Catalog of Candidates for Quasars at 3 < z < 5.5 Selected among X-Ray Sources from the 3XMM-DR4 Survey of the XMM-Newton Observatory
• Gaussian Mixture Models for Blended Photometric Redshifts
• Quasar photometric redshifts from incomplete data using Deep Learning
• The many flavours of photometric redshifts
• The Quasar Catalogue for S-PLUS DR4 (QuCatS) and the estimation of photometric redshifts
• Redshifts of radio sources in the Million Quasars Catalogue from machine learning
• Processing GOTO data with the Rubin Observatory LSST Science Pipelines II: Forced Photometry and light curves
• Cosmological-Scale Lyman-alpha Forest Absorption Around Galaxies and AGN Probed with the HETDEX and SDSS Spectroscopic Data
• Optical selection of quasars: SDSS and LSST
• Photometric Objects Around Cosmic Webs (PAC). VI. High Satellite Fraction of Quasars
• AllBRICQS: The Discovery of Luminous Quasars in the Northern Hemisphere