The Overlooked Potential of Generalized Linear Models in Astronomy-II: Gamma regression and photometric redshifts
arXiv:1409.7699 · doi:10.1016/j.ascom.2015.01.002
Abstract
Machine learning techniques offer a precious tool box for use within astronomy to solve problems involving so-called big data. They provide a means to make accurate predictions about a particular system without prior knowledge of the underlying physical processes of the data. In this article, and the companion papers of this series, we present the set of Generalized Linear Models (GLMs) as a fast alternative method for tackling general astronomical problems, including the ones related to the machine learning paradigm. To demonstrate the applicability of GLMs to inherently positive and continuous physical observables, we explore their use in estimating the photometric redshifts of galaxies from their multi-wavelength photometry. Using the gamma family with a log link function we predict redshifts from the PHoto-z Accuracy Testing simulated catalogue and a subset of the Sloan Digital Sky Survey from Data Release 10. We obtain fits that result in catastrophic outlier rates as low as ~1% for simulated and ~2% for real data. Moreover, we can easily obtain such levels of precision within a matter of seconds on a normal desktop computer and with training sets that contain merely thousands of galaxies. Our software is made publicly available as an user-friendly package developed in Python, R and via an interactive web application (https://cosmostatisticsinitiative.shinyapps.io/CosmoPhotoz). This software allows users to apply a set of GLMs to their own photometric catalogues and generates publication quality plots with minimum effort from the user. By facilitating their ease of use to the astronomical community, this paper series aims to make GLMs widely known and to encourage their implementation in future large-scale projects, such as the Large Synoptic Survey Telescope.
19 pages, 7 figures, 1 table, accepted for publication in Astronomy and Computing
References in corpus (5)
- The Fundamental Properties of Galaxies and a New Galaxy Classification System
- Photometric redshift analysis in the Dark Energy Survey Science Verification data
- Exhausting the Information: Novel Bayesian Combination of Photometric Redshift PDFs
- The Overlooked Potential of Generalized Linear Models in Astronomy - I: Binomial Regression
- A metric space for type Ia supernova spectra
Cited by in corpus (21)
- On the realistic validation of photometric redshifts, or why Teddy will never be Happy
- Photometry of high-redshift blended galaxies using deep learning
- Large Magellanic Cloud Near-Infrared Synoptic Survey. III. A Statistical Study of Non-Linearity in the Leavitt Laws
- The Overlooked Potential of Generalized Linear Models in Astronomy - I: Binomial Regression
- Clearing the hurdle: The mass of globular cluster systems as a function of host galaxy mass
- A probabilistic approach to emission-line galaxy classification
- The XXL survey XV: Evidence for dry merger driven BCG growth in XXL-100-GC X-ray clusters
- The Overlooked Potential of Generalized Linear Models in Astronomy-III: Bayesian Negative Binomial Regression and Globular Cluster Populations
- Is the cluster environment quenching the Seyfert activity in elliptical and spiral galaxies?
- 21st Century Statistical and Computational Challenges in Astrophysics
- Spatial field reconstruction with INLA: Application to IFU galaxy data
- KLLR: A scale-dependent, multivariate model class for regression analysis
- A case study of hurdle and generalized additive models in astronomy: the escape of ionizing radiation
- Multiplicity of stars with planets in the solar neighbourhood
- The HERBAL model: A hierarchical errors-in-variables Bayesian lognormal hurdle model for galactic globular cluster populations
- Fallopian tube anatomy predicts pregnancy and pregnancy outcomes after tubal reversal surgery
- Probing the origins. I. Generalised Additive Model inference of birth radii for Milky Way stars in the solar vicinity
- Simulation-based marginal likelihood for cluster strong lensing cosmology
- Using gamma regression for photometric redshifts of survey galaxies
- Modeling Globular Cluster Counts with Bayesian Latent Models
- Photometric redshifts for quasars from WISE-PS1-STRM