Automated reliability assessment for spectroscopic redshift measurements
arXiv:1706.01103 · doi:10.1051/0004-6361/201731305
Abstract
We present a new approach to automate the spectroscopic redshift reliability assessment based on machine learning (ML) and characteristics of the redshift probability density function (PDF). We propose to rephrase the spectroscopic redshift estimation into a Bayesian framework, in order to incorporate all sources of information and uncertainties related to the redshift estimation process, and produce a redshift posterior PDF that will be the starting-point for ML algorithms to provide an automated assessment of a redshift reliability. As a use case, public data from the VIMOS VLT Deep Survey is exploited to present and test this new methodology. We first tried to reproduce the existing reliability flags using supervised classification to describe different types of redshift PDFs, but due to the subjective definition of these flags, soon opted for a new homogeneous partitioning of the data into distinct clusters via unsupervised classification. After assessing the accuracy of the new clusters via resubstitution and test predictions, unlabelled data from preliminary mock simulations for the Euclid space mission are projected into this mapping to predict their redshift reliability labels.
arXiv commentSubmitted on 02 June 2017 (v1). Revised on 08 September 2017 (v2). Latest version 28 September 2017 (this version v3)
References in corpus (19)
- The 6dF Galaxy Survey: Baryon Acoustic Oscillations and the Local Hubble Constant
- EAZY: A Fast, Public Photometric Redshift Code
- Accurate photometric redshifts for the CFHT Legacy Survey calibrated using the VIMOS VLT Deep Survey
- The 6dF Galaxy Survey: z \approx 0 measurement of the growth rate and sigma_8
- ANNz: estimating photometric redshifts using artificial neural networks
- The VIMOS VLT Deep Survey final data release: a spectroscopic sample of 35016 galaxies and AGN out to z~6.7 selected with 17.5<=i_{AB}<=24.7
- The VIMOS Ultra-Deep Survey: ~10,000 galaxies with spectroscopic redshifts to study galaxy assembly at early epochs 2<z<~6
- The VIMOS Public Extragalactic Redshift Survey (VIPERS). An unprecedented view of galaxies and large-scale structure at 0.5<z<1.2
- Cosmic Structure Growth and Dark Energy
- The Zurich Extragalactic Bayesian Redshift Analyzer (ZEBRA) and its first application: COSMOS
- The VIMOS Public Extragalactic Survey (VIPERS): First Data Release of 57 204 spectroscopic measurements
- Weak Lensing and Dark Energy
- The VVDS data reduction pipeline: introducing VIPGI, the VIMOS Interactive Pipeline and Graphical Interface
- The PRIsm MUlti-object Survey (PRIMUS). II. Data Reduction and Redshift Fitting
- Galaxy And Mass Assembly (GAMA): autoz spectral redshift measurements, confidence and errors
- EZ: A Tool for Automatic Redshift Measurement
- Photo-z for weak lensing tomography from space: the role of optical and near-IR photometry
- Designing a space-based galaxy redshift survey to probe dark energy
- Darth Fader: Using wavelets to obtain accurate redshifts of spectra at very low signal-to-noise
Cited by in corpus (4)
- A review of unsupervised learning in astronomy
- HST Grism-derived Forecasts for Future Galaxy Redshift Surveys
- The most massive, passive, and oldest galaxies at 0.5 < z < 2.1: Downsizing signature from galaxies selected from MgUV index
- Euclid: Testing photometric selection of emission-line galaxy targets