Photo-z-SQL: integrated, flexible photometric redshift computation in a database
arXiv:1611.01560 · doi:10.1016/j.ascom.2017.03.002
Abstract
We present a flexible template-based photometric redshift estimation framework, implemented in C#, that can be seamlessly integrated into a SQL database (or DB) server and executed on-demand in SQL. The DB integration eliminates the need to move large photometric datasets outside a database for redshift estimation, and utilizes the computational capabilities of DB hardware. The code is able to perform both maximum likelihood and Bayesian estimation, and can handle inputs of variable photometric filter sets and corresponding broad-band magnitudes. It is possible to take into account the full covariance matrix between filters, and filter zero points can be empirically calibrated using measurements with given redshifts. The list of spectral templates and the prior can be specified flexibly, and the expensive synthetic magnitude computations are done via lazy evaluation, coupled with a caching of results. Parallel execution is fully supported. For large upcoming photometric surveys such as the LSST, the ability to perform in-place photo-z calculation would be a significant advantage. Also, the efficient handling of variable filter sets is a necessity for heterogeneous databases, for example the Hubble Source Catalog, and for cross-match services such as SkyQuery. We illustrate the performance of our code on two reference photo-z estimation testing datasets, and provide an analysis of execution time and scalability with respect to different configurations. The code is available for download at https://github.com/beckrob/Photo-z-SQL.
14 pages, 5 figures. Minor revision accepted by Astronomy & Computing on 2017 March 11
References in corpus (31)
- Maps of Dust IR Emission for Use in Estimation of Reddening and CMBR Foregrounds
- The Sloan Digital Sky Survey: Technical Summary
- Measuring Reddening with SDSS Stellar Spectra and Recalibrating SFD
- Correcting for the Effects of Interstellar Extinction
- The Eleventh and Twelfth Data Releases of the Sloan Digital Sky Survey: Final Data from SDSS-III
- SDSS-III: Massive Spectroscopic Surveys of the Distant Universe, the Milky Way Galaxy, and Extra-Solar Planetary Systems
- EAZY: A Fast, Public Photometric Redshift Code
- Accurate photometric redshifts for the CFHT Legacy Survey calibrated using the VIMOS VLT Deep Survey
- COSMOS Photometric Redshifts with 30-bands for 2-deg2
- Bayesian photometric redshift estimation
- The Pan-STARRS1 Photometric System
- A Modified Magnitude System that Produces Well-Behaved Magnitudes, Colors, and Errors Even for Low Signal-to-Noise Ratio Measurements
- Galaxies in the Hubble Ultra Deep Field: I. Detection, Multiband Photometry, Photometric Redshifts, and Morphology
- A Critical Assessment of Photometric Redshift Methods: A CANDELS Investigation
- Photometric Response Functions of the SDSS Imager
- Slicing Through Multicolor Space: Galaxy Redshifts From Broadband Photometry
- Measuring the Redshift Evolution of Clustering: the Hubble Deep Field South
- PHAT: PHoto-z Accuracy Testing
- Photometric Redshifts for the SDSS Early Data Release
- Photometric redshifts for the SDSS Data Release 12
- ArborZ: Photometric Redshifts Using Boosted Decision Trees
- Estimating Photometric Redshifts Using Support Vector Machines
- Version 1 of the Hubble Source Catalog
- A Catalog of Color-based Redshift Estimates for z <~ 4 Galaxies in the Hubble Deep Field
- Reconstructing Galaxy Spectral Energy Distributions from Broadband Photometry
- A catalogue of photometric redshifts for the SDSS-DR9 galaxies
- On the realistic validation of photometric redshifts, or why Teddy will never be Happy
- A Unified Framework for Photometric Redshifts
- Photometric Redshifts based on standard SED fitting procedures
- Astronomical Data Fusion Tool Based on PostgreSQL
- Photometric Covariance in Multi-Band Surveys: Understanding the Photometric Error in the SDSS
Cited by in corpus (7)
- HELP: The Herschel Extragalactic Legacy Project
- On the realistic validation of photometric redshifts, or why Teddy will never be Happy
- PS1-STRM: Neural network source classification and photometric redshift catalogue for PS1 DR1
- TOPz: Photometric redshifts for J-PAS
- PICZL: Image-based Photometric Redshifts for AGN
- Quasar photometric redshifts from incomplete data using Deep Learning
- Hawaii Two-0: High-redshift galaxy clustering and bias