Augmenting machine learning photometric redshifts with Gaussian mixture models
arXiv:2009.01952 · doi:10.1093/mnras/staa2741
Abstract
Wide-area imaging surveys are one of the key ways of advancing our understanding of cosmology, galaxy formation physics, and the large-scale structure of the Universe in the coming years. These surveys typically require calculating redshifts for huge numbers (hundreds of millions to billions) of galaxies - almost all of which must be derived from photometry rather than spectroscopy. In this paper we investigate how using statistical models to understand the populations that make up the colour-magnitude distribution of galaxies can be combined with machine learning photometric redshift codes to improve redshift estimates. In particular we combine the use of Gaussian Mixture Models with the high performing machine learning photo-z algorithm GPz and show that modelling and accounting for the different colour-magnitude distributions of training and test data separately can give improved redshift estimates, reduce the bias on estimates by up to a half, and speed up the run-time of the algorithm. These methods are illustrated using data from deep optical and near infrared data in two separate deep fields, where training and test data of different colour-magnitude distributions are constructed from the galaxies with known spectroscopic redshifts, derived from several heterogeneous surveys.
16 pages, 13 figures, accepted MNRAS
References in corpus (59)
- The Eleventh and Twelfth Data Releases of the Sloan Digital Sky Survey: Final Data from SDSS-III
- EAZY: A Fast, Public Photometric Redshift Code
- Accurate photometric redshifts for the CFHT Legacy Survey calibrated using the VIMOS VLT Deep Survey
- Bayesian photometric redshift estimation
- The COSMOS2015 Catalog: Exploring the 1<z<6 Universe with half a million galaxies
- KiDS-450: Cosmological parameter constraints from tomographic weak gravitational lensing
- 3D-HST WFC3-selected Photometric Catalogs in the Five CANDELS/3D-HST Fields: Photometry, Photometric Redshifts and Stellar Masses
- Measuring and Modelling the Redshift Evolution of Clustering: the Hubble Deep Field North
- Euclid Definition Study Report
- LSST Science Book, Version 2.0
- UltraVISTA: a new ultra-deep near-infrared survey in COSMOS
- The 3D-HST Survey: Hubble Space Telescope WFC3/G141 grism spectra, redshifts, and emission line measurements for galaxies
- ANNz: estimating photometric redshifts using artificial neural networks
- A Modified Magnitude System that Produces Well-Behaved Magnitudes, Colors, and Errors Even for Low Signal-to-Noise Ratio Measurements
- Galaxies in the Hubble Ultra Deep Field: I. Detection, Multiband Photometry, Photometric Redshifts, and Morphology
- The VIMOS VLT Deep Survey final data release: a spectroscopic sample of 35016 galaxies and AGN out to z~6.7 selected with 17.5<=i_{AB}<=24.7
- A Critical Assessment of Photometric Redshift Methods: A CANDELS Investigation
- The VISTA Deep Extragalactic Observations (VIDEO) Survey
- The Chandra COSMOS Legacy survey: optical/IR identifications
- The PRIsm MUlti-Object Survey (PRIMUS) I: Survey Overview and Characteristics
- Obscuration-dependent evolution of Active Galactic Nuclei
- TPZ : Photometric redshift PDFs and ancillary information by using prediction trees and random forests
- The Zurich Extragalactic Bayesian Redshift Analyzer (ZEBRA) and its first application: COSMOS
- The DEIMOS 10k spectroscopic survey catalog of the COSMOS field
- A lack of evolution in the very bright-end of the galaxy luminosity function from z = 8-10
- Faint Galaxies in deep ACS observations
- Estimating the Redshift Distribution of Faint Galaxy Samples
- Mapping the Galaxy Color-Redshift Relation: Optimal Photometric Redshift Calibration Strategies for Cosmology Surveys
- Dark Energy Survey Year 1 Results: Redshift distributions of the weak lensing source galaxies
- ANNz2 - photometric redshift and probability distribution function estimation using machine learning
- The PRIsm MUlti-object Survey (PRIMUS). II. Data Reduction and Redshift Fitting
- Photometric redshift estimation via deep learning
- The FMOS-COSMOS survey of star-forming galaxies at z~1.6 III. Survey design, performance, and sample characteristics
- The VANDELS ESO public spectroscopic survey: observations and first data release
- The VANDELS ESO public spectroscopic survey
- Galaxy And Mass Assembly (GAMA): The input catalogue and star-galaxy separation
- GPz: Non-stationary sparse Gaussian processes for heteroscedastic uncertainty estimation in photometric redshifts
- The CFHT Large Area U-band Deep Survey (CLAUDS)
- A Comparison of Six Photometric Redshift Methods Applied to 1.5 Million Luminous Red Galaxies
- The XMM-SERVS survey: new XMM-Newton point-source catalog for the XMM-LSS field
- Photometric redshifts for the next generation of deep radio continuum surveys - I: Template fitting
- Identifying Strong Lenses with Unsupervised Machine Learning using Convolutional Autoencoder
- A Sparse Gaussian Process Framework for Photometric Redshift Estimation
- METAPHOR: A machine learning based method for the probability density estimation of photometric redshifts
- On the compared accuracy and reliability of spectroscopic and photometric redshift measurements
- A General Study of the Influence of Catastrophic Photometric Redshift Errors on Cosmology with Cosmic Shear Tomography
- Scientific Synergy Between LSST and Euclid
- On the realistic validation of photometric redshifts, or why Teddy will never be Happy
- Photometric Redshifts for the Dark Energy Survey and VISTA and Implications for Large Scale Structure
- The rest-frame UV luminosity function at : a significant contribution of AGN to the bright-end of the galaxy population
- Hierarchical Bayesian inference of galaxy redshift distributions from photometric surveys
- CPz: Classification-aided photometric-redshift estimation
- Improving Photometric Redshift Estimation using GPz: size information, post processing and improved photometry
- Photometric redshift estimation using Gaussian processes
- Photometric redshifts for X-ray-selected active galactic nuclei in the eROSITA era
- A Comparison of Photometric Redshift Techniques for Large Radio Surveys
- The ALHAMBRA survey : band luminosity function of quiescent and star-forming galaxies at by PDF analysis
- Using Sparse Gaussian Processes for Predicting Robust Inertial Confinement Fusion Implosion Yields
- Mixture Models in Astronomy
Cited by in corpus (11)
- All-purpose, all-sky photometric redshifts for the Legacy Imaging Surveys Data Release 8
- Photometric Redshift Estimation with a Convolutional Neural Network: NetZ
- MIGHTEE: the nature of the radio-loud AGN population
- The LSST-DESC 3x2pt Tomography Optimization Challenge
- Hybrid photometric redshifts for sources in the COSMOS and XMM-LSS fields
- PICZL: Image-based Photometric Redshifts for AGN
- Machine Learning Classification to Identify Catastrophic Outlier Photometric Redshift Estimates
- The sensitivity of GPz estimates of photo-z posterior PDFs to realistically complex training set imperfections
- CLAP. I. Resolving miscalibration for deep learning-based galaxy photometric redshift estimation
- TOPz: Photometric redshifts using template fitting applied to the GAMA survey
- Photometric Redshift Estimation with Convolutional Neural Networks and Galaxy Images: A Case Study of Resolving Biases in Data-Driven Methods