Optimising a magnitude-limited spectroscopic training sample for photometric classification of supernovae

Abstract

In preparation for photometric classification of transients from the Legacy Survey of Space and Time (LSST) we run tests with different training data sets. Using estimates of the depth to which the 4-metre Multi-Object Spectroscopic Telescope (4MOST) Time Domain Extragalactic Survey (TiDES) can classify transients, we simulate a magnitude-limited sample reaching $r_{\text{AB}}\approx$ 22.5 mag. We run our simulations with the software snmachine, a photometric classification pipeline using machine learning. The machine-learning algorithms struggle to classify supernovae when the training sample is magnitude-limited, in contrast to representative training samples. Classification performance noticeably improves when we combine the magnitude-limited training sample with a simulated realistic sample of faint, high-redshift supernovae observed from larger spectroscopic facilities; the algorithms' range of average area under ROC curve (AUC) scores over 10 runs increases from 0.547-0.628 to 0.946-0.969 and purity of the classified sample reaches 95 per cent in all runs for 2 of the 4 algorithms. By creating new, artificial light curves using the augmentation software avocado, we achieve a purity in our classified sample of 95 per cent in all 10 runs performed for all machine-learning algorithms considered. We also reach a highest average AUC score of 0.986 with the artificial neural network algorithm. Having `true' faint supernovae to complement our magnitude-limited sample is a crucial requirement in optimisation of a 4MOST spectroscopic sample. However, our results are a proof of concept that augmentation is also necessary to achieve the best classification results.

arXiv commentMNRAS accepted version Aug 2021

References in corpus (26)

• Observational Evidence from Supernovae for an Accelerating Universe and a Cosmological Constant
• Measurements of Omega and Lambda from 42 High-Redshift Supernovae
• SALT2: using distant supernovae to improve the use of Type Ia supernovae as distance indicators
• Nearby Supernova Rates from the Lick Observatory Supernova Search. II. The Observed Luminosity Functions and Fractions of Supernovae in a Complete Sample
• 4MOST: Project overview and information for the First Call for Proposals
• Photometric Supernova Classification With Machine Learning
• SuperNNova: an open-source framework for Bayesian, Neural Network based supernova classification
• Results from the Supernova Photometric Classification Challenge
• Star Formation History up to z = 7.4: Implications for Gamma-Ray Bursts and the Cosmic Metallicity Evolution
• Absolute-Magnitude Distributions of Supernovae
• RAPID: Early Classification of Explosive Transients using Deep Learning
• Avocado: Photometric Classification of Astronomical Transients with Gaussian Process Augmentation
• Deep Recurrent Neural Networks for Supernovae Classification
• The LSST Dark Energy Science Collaboration (DESC) Science Requirements Document
• The Core Collapse Supernova Rate from the SDSS-II Supernova Survey
• Optimizing spectroscopic follow-up strategies for supernova photometric classification with active learning
• On the realistic validation of photometric redshifts, or why Teddy will never be Happy
• The volumetric rate of normal type Ia supernovae in the local universe discovered by the Palomar Transient Factory
• The ESO/VLT 3rd year Type Ia supernova data set from the Supernova Legacy Survey
• STACCATO: A Novel Solution to Supernova Photometric Classification with Biased Training Sets
• 4MOST Consortium Survey 10: The Time-Domain Extragalactic Survey (TiDES)
• Photometric Redshifts with the LSST II: The Impact of Near-Infrared and Near-Ultraviolet Photometry
• Cosmology Requirements on Supernova Photometric Redshift Systematics for Rubin LSST and Roman Space Telescope
• Photometric Supernovae Redshift Systematics Requirements
• Probabilistic fibre-to-target assignment algorithm for multi-object spectroscopic surveys
• An optimised tiling pattern for multi-object spectroscopic surveys: application to the 4MOST survey

Cited by in corpus (7)

• Light curve classification with recurrent neural networks for GOTO: dealing with imbalanced data
• Pan-chromatic photometric classification of supernovae from multiple surveys and transfer learning for future surveys
• TiDES: The 4MOST Time Domain Extragalactic Survey
• Impact of Rubin Observatory cadence choices on supernovae photometric classification
• SNGuess: A method for the selection of young extragalactic transients
• Real-Time Active Learning for optimised spectroscopic follow-up: Enhancing early SN Ia classification with the Fink broker
• Considerations for optimizing photometric classification of supernovae from the Rubin Observatory