DES Science Portal: Computing Photometric Redshifts

Abstract

A significant challenge facing photometric surveys for cosmological purposes is the need to produce reliable redshift estimates. The estimation of photometric redshifts (photo-zs) has been consolidated as the standard strategy to bypass the high production costs and incompleteness of spectroscopic redshift samples. Training-based photo-z methods require the preparation of a high-quality list of spectroscopic redshifts, which needs to be constantly updated. The photo-z training, validation, and estimation must be performed in a consistent and reproducible way in order to accomplish the scientific requirements. To meet this purpose, we developed an integrated web-based data interface that not only provides the framework to carry out the above steps in a systematic way, enabling the ease testing and comparison of different algorithms, but also addresses the processing requirements by parallelizing the calculation in a transparent way for the user. This framework called the Science Portal (hereafter Portal) was developed in the context the Dark Energy Survey (DES) to facilitate scientific analysis. In this paper, we show how the Portal can provide a reliable environment to access vast data sets, provide validation algorithms and metrics, even in the case of multiple photo-zs methods. It is possible to maintain the provenance between the steps of a chain of workflows while ensuring reproducibility of the results. We illustrate how the Portal can be used to provide photo-z estimates using the DES first year (Y1A1) data. While the DES collaboration is still developing techniques to obtain more precise photo-zs, having a structured framework like the one presented here is critical for the systematic vetting of DES algorithmic improvements and the consistent production of photo-zs in the future DES releases.

arXiv commentThe first paper of the series about the DES Science Portal, submitted to the Astronomy & Computing journal. It shows the infrastructure of pipelines related to the production of photometric redshifts to feed science-ready catalogs

References in corpus (82)

• Maps of Dust IR Emission for Use in Estimation of Reddening and CMBR Foregrounds
• The Seventh Data Release of the Sloan Digital Sky Survey
• The Eleventh and Twelfth Data Releases of the Sloan Digital Sky Survey: Final Data from SDSS-III
• The 2dF Galaxy Redshift Survey: Spectra and redshifts
• Accurate photometric redshifts for the CFHT Legacy Survey calibrated using the VIMOS VLT Deep Survey
• Bayesian photometric redshift estimation
• Galaxy and Mass Assembly (GAMA): survey diagnostics and core data release
• The 6dF Galaxy Survey: Final Redshift Release (DR3) and Southern Large-Scale Structures
• The Dark Energy Camera
• The Dark Energy Survey: more than dark energy - an overview
• The Tenth Data Release of the Sloan Digital Sky Survey: First Spectroscopic Data from the SDSS-III Apache Point Observatory Galactic Evolution Experiment
• The 3D-HST Survey: Hubble Space Telescope WFC3/G141 grism spectra, redshifts, and emission line measurements for $\sim 100,000$ galaxies
• The 10 Meter South Pole Telescope
• The All-wavelength Extended Groth Strip International Survey (AEGIS) Data Sets
• The Las Campanas Redshift Survey
• Science Objectives and Early Results of the DEEP2 Redshift Survey
• COSMOS : Hubble Space Telescope Observations
• ANNz: estimating photometric redshifts using artificial neural networks
• The Dark Energy Survey Data Release 1
• The VIMOS VLT Deep Survey - First epoch VVDS-Deep survey: 11564 spectra with 17.5<=IAB<=24, and the redshift distribution over 0< z <=5
• Cosmological Constraints from Measurements of Type Ia Supernovae discovered during the first 1.5 years of the Pan-STARRS1 Survey
• The Gemini Cluster Astrophysics Spectroscopic Survey (GCLASS): The Role of Environment and Self-Regulation in Galaxy Evolution at z ~ 1
• The PRIsm MUlti-Object Survey (PRIMUS) I: Survey Overview and Characteristics
• The VIMOS VLT Deep Survey: Public release of 1599 redshifts to IAB<=24 across the Chandra Deep Field South
• Calibrating Redshift Distributions Beyond Spectroscopic Limits with Cross-Correlations
• The WiggleZ Dark Energy Survey: Final data release and cosmological results
• Effect of Photometric Redshift Uncertainties on Weak Lensing Tomography
• Measuring the Redshift Evolution of Clustering: the Hubble Deep Field South
• TPZ : Photometric redshift PDFs and ancillary information by using prediction trees and random forests
• PHAT: PHoto-z Accuracy Testing
• The VIMOS Public Extragalactic Survey (VIPERS): First Data Release of 57 204 spectroscopic measurements
• The SAGA Survey: I. Satellite Galaxy Populations Around Eight Milky Way Analogs
• The Blanco Cosmology Survey: Data Acquisition, Processing, Calibration, Quality Diagnostics and Data Release
• The Grism Lens-Amplified Survey from Space (GLASS). I. Survey overview and first data release
• Estimating the Redshift Distribution of Faint Galaxy Samples
• Dark Energy Survey Year 1 Results: Redshift distributions of the weak lensing source galaxies
• ANNz2 - photometric redshift and probability distribution function estimation using machine learning
• The PRIsm MUlti-object Survey (PRIMUS). II. Data Reduction and Redshift Fitting
• Photometric redshift analysis in the Dark Energy Survey Science Verification data
• Cosmology from Cosmic Shear with DES Science Verification Data
• Systematic Uncertainties Associated with the Cosmological Analysis of the First Pan-STARRS1 Type Ia Supernova Sample
• The Difference Imaging Pipeline for the Transient Search in the Dark Energy Survey
• The ALHAMBRA Project: A large area multi medium-band optical and NIR photometric survey
• The Vimos VLT Deep Survey: Global properties of 20000 galaxies in the I_AB<=22.5 WIDE survey
• The FMOS-COSMOS survey of star-forming galaxies at z~1.6 III. Survey design, performance, and sample characteristics
• Redshift distributions of galaxies in the DES Science Verification shear catalogue and implications for weak lensing
• Estimating the Redshift Distribution of Photometric Galaxy Samples II. Applications and Tests of a New Method
• The Complete Calibration of the Color-Redshift Relation (C3R2) Survey: Survey Overview and Data Release 1
• ArborZ: Photometric Redshifts Using Boosted Decision Trees
• DNF - Galaxy photometric redshift by Directional Neighbourhood Fitting
• The VIMOS Ultra Deep Survey First Data Release: spectra and spectroscopic redshifts of 698 objects up to z~6 in CANDELS
• Stellar Locus Regression: Accurate Color Calibration, and the Real-time Determination of Galaxy Cluster Photometric Redshifts
• The Arizona CDFS Environment Survey (ACES): A Magellan/IMACS Spectroscopic Survey of the Chandra Deep Field South
• The Sloan Digital Sky Survey Stripe 82 Imaging Data: Depth-Optimized Co-adds Over 300 Deg^2 in Five Filters
• OzDES multi-fibre spectroscopy for the Dark Energy Survey: first-year operation and results
• SKYNET: an efficient and robust neural network training tool for machine learning in astronomy
• OzDES multifibre spectroscopy for the Dark Energy Survey: Three year results and first data release
• The 2-degree Field Lensing Survey: design and clustering measurements
• ZFIRE: A KECK/MOSFIRE Spectroscopic Survey of Galaxies in Rich Environments at z~2
• Dark Energy Survey Year 1 Results: Cross-Correlation Redshifts - Methods and Systematics Characterization
• The Dark Energy Survey Data Processing and Calibration System
• A General Study of the Influence of Catastrophic Photometric Redshift Errors on Cosmology with Cosmic Shear Tomography
• Photometric selection of Type Ia supernovae in the Supernova Legacy Survey
• Photometric Redshift Requirements for Self-Calibration of Cluster Dark Energy Studies
• SPT-GMOS: A Gemini/GMOS-South Spectroscopic Survey of Galaxy Clusters in the SPT-SZ Survey
• The Australia Telescope Large Area Survey: Spectroscopic Catalogue and Radio Luminosity Functions
• Modelling the Transfer Function for the Dark Energy Survey
• Redshift Accuracy Requirements for Future Supernova and Number Count Surveys
• Size of spectroscopic calibration samples for cosmic shear photometric redshifts
• Photometric redshift estimation based on data mining with PhotoRApToR
• Data augmentation for machine learning redshifts applied to SDSS galaxies
• Dark Energy Survey Year 1 Results: Cross-Correlation Redshifts in the DES -- Calibration of the Weak Lensing Source Redshift Distributions
• Combining Dark Energy Survey Science Verification Data with Near Infrared Data from the ESO VISTA Hemisphere Survey
• Spectroscopic failures in photometric redshift calibration: cosmological biases and survey requirements
• Optical identification of XMM sources in the CFHTLS
• Large scale clustering measurements with photometric redshifts: comparing the dark matter halos of X-ray AGN, star-forming and passive galaxies at z~1
• Observation and Confirmation of Six Strong Lensing Systems in The Dark Energy Survey Science Verification Data
• The XXL survey XIV. AAOmega redshifts for the southern XXL field
• DAMEWARE: A web cyberinfrastructure for astrophysical data mining
• Optimal multihump filter for photometric redshifts
• An Efficient Approach to Obtaining Large Numbers of Distant Supernova Host Galaxy Redshifts
• DES Science Portal: Creating Science-Ready Catalogs

Cited by in corpus (17)

• First measurement of the Hubble constant from a dark standard siren using the Dark Energy Survey galaxies and the LIGO/Virgo binary-black-hole merger GW170814
• Dark Energy Survey Year 3 Results: Photometric Data Set for Cosmology
• A statistical standard siren measurement of the Hubble constant from the LIGO/Virgo gravitational wave compact object merger GW190814 and Dark Energy Survey galaxies
• OzDES multi-object fibre spectroscopy for the Dark Energy Survey: Results and second data release
• Dark Energy Survey Year 3 results: Cosmological constraints from galaxy clustering and galaxy-galaxy lensing using the MagLim lens sample
• Dark Energy Survey Year 3 Results: Optimizing the Lens Sample in Combined Galaxy Clustering and Galaxy-Galaxy Lensing Analysis
• The impact of spectroscopic incompleteness in direct calibration of redshift distributions for weak lensing surveys
• Pushing automated morphological classifications to their limits with the Dark Energy Survey
• The WaZP galaxy cluster sample of the Dark Energy Survey Year 1
• Euclid preparation: XII. Optimizing the photometric sample of the Euclid survey for galaxy clustering and galaxy-galaxy lensing analyses
• Modelling the Milky Way. I -- Method and first results fitting the thick disk and halo with DES-Y3 data
• Velocity Dispersions of Clusters in the Dark Energy Survey Y3 redMaPPer Catalog
• Dark Energy Survey Year 3 Results: Redshift Calibration of the MagLim Lens Sample from the combination of SOMPZ and clustering and its impact on Cosmology
• Dark Energy Survey: Galaxy Sample for the Baryonic Acoustic Oscillation Measurement from the Final Dataset
• The XXL Survey L. Active galactic nucleus contamination in galaxy clusters: Detection and cosmological impact
• Dark Energy Survey Deep Field photometric redshift performance and training incompleteness assessment
• Dark Energy Survey Year 3 Results: Galaxy Sample for BAO Measurement