STACCATO: A Novel Solution to Supernova Photometric Classification with Biased Training Sets

Abstract

We present a new solution to the problem of classifying Type Ia supernovae from their light curves alone given a spectroscopically confirmed but biased training set, circumventing the need to obtain an observationally expensive unbiased training set. We use Gaussian processes (GPs) to model the supernovae's (SN) light curves, and demonstrate that the choice of covariance function has only a small influence on the GPs ability to accurately classify SNe. We extend and improve the approach of Richards et al (2012} -- a diffusion map combined with a random forest classifier -- to deal specifically with the case of biassed training sets. We propose a novel method, called STACCATO (SynThetically Augmented Light Curve ClassificATiOn') that synthetically augments a biased training set by generating additional training data from the fitted GPs. Key to the success of the method is the partitioning of the observations into subgroups based on their propensity score of being included in the training set. Using simulated light curve data, we show that STACCATO increases performance, as measured by the area under the Receiver Operating Characteristic curve (AUC), from 0.93 to 0.96, close to the AUC of 0.977 obtained using the 'gold standard' of an unbiased training set and significantly improving on the previous best result of 0.88. STACCATO also increases the true positive rate for SNIa classification by up to a factor of 50 for high-redshift/low brightness SNe.

Matches version accepted by MNRAS, v3 only changes metadata to point to zenodo repository for the code. The STACCATO code is available from https://doi.org/10.5281/zenodo.3701464

References in corpus (5)

• Some Aspects of Measurement Error in Linear Regression of Astronomical Data
• Correcting Type Ia Supernova Distances for Selection Biases and Contamination in Photometrically Identified Samples
• Results from the Supernova Photometric Classification Challenge
• Bayesian Estimation Applied to Multiple Species: Towards cosmology with a million supernovae
• Data augmentation for machine learning redshifts applied to SDSS galaxies

Cited by in corpus (32)

• The Automatic Learning for the Rapid Classification of Events (ALeRCE) Alert Broker
• Measuring Dark Energy Properties with Photometrically Classified Pan-STARRS Supernovae. II. Cosmological Parameters
• RAPID: Early Classification of Explosive Transients using Deep Learning
• Avocado: Photometric Classification of Astronomical Transients with Gaussian Process Augmentation
• SuperRAENN: A Semi-supervised Supernova Photometric Classification Pipeline Trained on Pan-STARRS1 Medium Deep Survey Supernovae
• Optimizing spectroscopic follow-up strategies for supernova photometric classification with active learning
• Anomaly Detection in the Open Supernova Catalog
• Imbalance Learning for Variable Star Classification
• Comparing Multi-class, Binary and Hierarchical Machine Learning Classification schemes for variable stars
• Machine Learning for Observational Cosmology
• SICRET: Supernova Ia Cosmology with truncated marginal neural Ratio EsTimation
• Light curve classification with recurrent neural networks for GOTO: dealing with imbalanced data
• 21st Century Statistical and Computational Challenges in Astrophysics
• Classification of Multiwavelength Transients with Machine Learning
• Strong-lensing source reconstruction with variationally optimised Gaussian processes
• Projected distances to host galaxy reduce SNIa dispersion
• Optimising a magnitude-limited spectroscopic training sample for photometric classification of supernovae
• PICZL: Image-based Photometric Redshifts for AGN
• Impact of Rubin Observatory cadence choices on supernovae photometric classification
• SIDE-real: Supernova Ia Dust Extinction with truncated marginal neural ratio estimation applied to real data
• Photometric Data-driven Classification of Type Ia Supernovae in the Open Supernova Catalog
• Data challenges as a tool for time-domain astronomy
• Stratified Learning: A General-Purpose Statistical Method for Improved Learning under Covariate Shift
• GausSN: Bayesian Time-Delay Estimation for Strongly Lensed Supernovae
• How to set up your first machine learning project in astronomy
• Real-time Light Curve Classification Framework for the Wide Field Survey Telescope Using Modified Semi-supervised Variational Auto-Encoder
• Using Random Forest Machine Learning Algorithms in Binary Supernovae Classification
• Considerations for optimizing photometric classification of supernovae from the Rubin Observatory
• Optimizing Supernova Classification with Interpretable Machine Learning Models
• AMPEL workflows for LSST: Modular and reproducible real-time photometric classification
• Six Maxims of Statistical Acumen for Astronomical Data Analysis
• Characterizing the Sample Selection for Supernova Cosmology