The Overlooked Potential of Generalized Linear Models in Astronomy - I: Binomial Regression
arXiv:1409.7696 · doi:10.1016/j.ascom.2015.04.002
Abstract
Revealing hidden patterns in astronomical data is often the path to fundamental scientific breakthroughs; meanwhile the complexity of scientific inquiry increases as more subtle relationships are sought. Contemporary data analysis problems often elude the capabilities of classical statistical techniques, suggesting the use of cutting edge statistical methods. In this light, astronomers have overlooked a whole family of statistical techniques for exploratory data analysis and robust regression, the so-called Generalized Linear Models (GLMs). In this paper -- the first in a series aimed at illustrating the power of these methods in astronomical applications -- we elucidate the potential of a particular class of GLMs for handling binary/binomial data, the so-called logit and probit regression techniques, from both a maximum likelihood and a Bayesian perspective. As a case in point, we present the use of these GLMs to explore the conditions of star formation activity and metal enrichment in primordial minihaloes from cosmological hydro-simulations including detailed chemistry, gas physics, and stellar feedback. We predict that for a dark mini-halo with metallicity , an increase of in the gas molecular fraction, increases the probability of star formation occurrence by a factor of 75%. Finally, we highlight the use of receiver operating characteristic curves as a diagnostic for binary classifiers, and ultimately we use these to demonstrate the competitive predictive performance of GLMs against the popular technique of artificial neural networks.
arXiv comment20 pages, 10 figures, 3 tables, accepted for publication in Astronomy and Computing
References in corpus (36)
- Seven-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Cosmological Interpretation
- The cosmological simulation code GADGET-2
- Mass and environment as drivers of galaxy evolution in SDSS and zCOSMOS and the origin of the Schechter function
- A weakly informative default prior distribution for logistic and other regression models
- Simulations of Early Structure Formation: Primordial Gas Clouds
- On the Estimation of Confidence Intervals for Binomial Population Proportions in Astronomy: The Simplicity and Superiority of the Bayesian Approach
- The Birth of a Galaxy - III. Propelling reionisation with the faintest galaxies
- Chemical enrichment of galaxy clusters from hydrodynamical simulations
- Formation of the First Stars
- Protostellar Collapse with Various Metallicities
- The transition from population III to population II-I star formation
- Galaxy Zoo: An independent look at the evolution of the bar fraction over the last eight billion years from HST-COSMOS
- Metal and molecule cooling in simulations of structure formation
- Metal and molecule cooling in simulations of structure formation
- Influence of Stellar Multiplicity On Planet Formation. II. Planets Are Less Common in Multiple-Star Systems with Separations Smaller than 1500 AU
- The interplay between chemical and mechanical feedback from the first generation of stars
- Population III.1 and III.2 gamma-Ray Bursts: Constraints on the event rate for future radio and X-ray surveys
- The stellar-to-halo mass relations of local galaxies segregates by color
- Finding the First Cosmic Explosions I: Pair-Instability Supernovae
- Seeing the First Supernovae at the Edge of the Universe with JWST
- Bayesian inference of cosmic density fields from non-linear, scale-dependent, and stochastic biased tracers
- Simulating high-z Gamma-ray Burst host galaxies
- Early structure formation in quintessence models and its implications for cosmic reionisation from first stars
- Detectability of the First Cosmic Explosions
- Galaxy mass, cluster-centric distance and secular evolution: their role in the evolution of galaxies in clusters in the last 10 Gyr
- The onset of star formation in primordial haloes
- Dark Matter Halo Environment for Primordial Star Formation
- Functional Uniform Priors for Nonlinear Modelling
- Robust PCA and MIC statistics of baryons in early mini-haloes
- The Overlooked Potential of Generalized Linear Models in Astronomy-II: Gamma regression and photometric redshifts
- Barred S0 Galaxies in the Coma Cluster
- Feature Selection Strategies for Classifying High Dimensional Astronomical Data Sets
- Statistical properties of mass, star formation, chemical content and rotational patterns in early z > 9 structures
- Simulating extremely metal-poor gas and DLA metal content at redshift z=7
- Searching for the first stars with the Gaia mission
- Do cluster properties affect the quenching rate?
Cited by in corpus (24)
- Forecasting Solar Flares Using Magnetogram-based Predictors and Machine Learning
- On the realistic validation of photometric redshifts, or why Teddy will never be Happy
- Large Magellanic Cloud Near-Infrared Synoptic Survey. III. A Statistical Study of Non-Linearity in the Leavitt Laws
- Origin of Cosmic Chemical Abundances
- Clearing the hurdle: The mass of globular cluster systems as a function of host galaxy mass
- The Overlooked Potential of Generalized Linear Models in Astronomy-III: Bayesian Negative Binomial Regression and Globular Cluster Populations
- The Overlooked Potential of Generalized Linear Models in Astronomy-II: Gamma regression and photometric redshifts
- Do the stellar populations of the brightest two group galaxies depend on the magnitude gap?
- Is the cluster environment quenching the Seyfert activity in elliptical and spiral galaxies?
- The seeds of supermassive black holes and the role of local radiation and metal spreading
- 21st Century Statistical and Computational Challenges in Astrophysics
- Mode jumping MCMC for Bayesian variable selection in GLMM
- Spatial field reconstruction with INLA: Application to IFU galaxy data
- KLLR: A scale-dependent, multivariate model class for regression analysis
- A case study of hurdle and generalized additive models in astronomy: the escape of ionizing radiation
- Multiplicity of stars with planets in the solar neighbourhood
- Dust in a compact, cold, high-velocity cloud: A new approach to removing foreground emission
- UV bright red-sequence galaxies: how do UV upturn systems evolve in redshift and stellar mass?
- The HERBAL model: A hierarchical errors-in-variables Bayesian lognormal hurdle model for galactic globular cluster populations
- Fallopian tube anatomy predicts pregnancy and pregnancy outcomes after tubal reversal surgery
- Probing the origins. I. Generalised Additive Model inference of birth radii for Milky Way stars in the solar vicinity
- Simulation-based marginal likelihood for cluster strong lensing cosmology
- A high occurrence of nuclear star clusters in faint Coma galaxies, and the roles of mass and environment
- Modeling Globular Cluster Counts with Bayesian Latent Models