Deep Attention-Based Supernovae Classification of Multi-Band Light-Curves

Abstract

In astronomical surveys, such as the Zwicky Transient Facility, supernovae (SNe) are relatively uncommon objects compared to other classes of variable events. Along with this scarcity, the processing of multi-band light-curves is a challenging task due to the highly irregular cadence, long time gaps, missing-values, few observations, etc. These issues are particularly detrimental to the analysis of transient events: SN-like light-curves. We offer three main contributions: 1) Based on temporal modulation and attention mechanisms, we propose a Deep attention model (TimeModAttn) to classify multi-band light-curves of different SN types, avoiding photometric or hand-crafted feature computations, missing-value assumptions, and explicit imputation/interpolation methods. 2) We propose a model for the synthetic generation of SN multi-band light-curves based on the Supernova Parametric Model, allowing us to increase the number of samples and the diversity of cadence. Thus, the TimeModAttn model is first pre-trained using synthetic light-curves. Then, a fine-tuning process is performed. The TimeModAttn model outperformed other Deep Learning models, based on Recurrent Neural Networks, in two scenarios: late-classification and early-classification. Also, the TimeModAttn model outperformed a Balanced Random Forest (BRF) classifier (trained with real data), increasing the balanced-$F_1$score from $\approx .525$ to $\approx .596$. When training the BRF with synthetic data, this model achieved similar performance to the TimeModAttn model proposed while still maintaining extra advantages. 3) We conducted interpretability experiments. High attention scores were obtained for observations earlier than and close to the SN brightness peaks. This also correlated with an early highly variability of the learned temporal modulation.

arXiv commentSubmitted to AJ on 14-Jan-2022

References in corpus (39)

• Observational Evidence from Supernovae for an Accelerating Universe and a Cosmological Constant
• emcee: The MCMC Hammer
• LSST: from Science Drivers to Reference Design and Anticipated Data Products
• The Zwicky Transient Facility: System Overview, Performance, and First Results
• The High-Z Supernova Search: Measuring Cosmic Deceleration and Global Cur vature of the Universe Using Type Ia Supernovae
• The Dark Energy Survey: more than dark energy - an overview
• Photometric Supernova Classification With Machine Learning
• The Automatic Learning for the Rapid Classification of Events (ALeRCE) Alert Broker
• SuperNNova: an open-source framework for Bayesian, Neural Network based supernova classification
• RAPID: Early Classification of Explosive Transients using Deep Learning
• Alert Classification for the ALeRCE Broker System: The Light Curve Classifier
• A recurrent neural network for classification of unevenly sampled variable stars
• Avocado: Photometric Classification of Astronomical Transients with Gaussian Process Augmentation
• Deep Recurrent Neural Networks for Supernovae Classification
• Early light curves for Type Ia supernova explosion models
• Type Ia supernovae, standardisable candles, and gravity
• Missing Red Supergiants and Carbon Burning
• Kernel PCA for type Ia supernovae photometric classification
• Supernova Photometric Classification Pipelines Trained on Spectroscopically Classified Supernovae from the Pan-STARRS1 Medium-Deep Survey
• A simple and robust method for automated photometric classification of supernovae using neural networks
• Alert Classification for the ALeRCE Broker System: The Real-time Stamp Classifier
• Anomaly detection in the Zwicky Transient Facility DR3
• The High Cadence Transient Survey (HiTS) - I. Survey design and supernova shock breakout constraints
• Scalable End-to-end Recurrent Neural Network for Variable star classification
• PELICAN: deeP architecturE for the LIght Curve ANalysis
• A Deep Learning Approach for Active Anomaly Detection of Extragalactic Transients
• Searching for changing-state AGNs in massive datasets -- I: applying deep learning and anomaly detection techniques to find AGNs with anomalous variability behaviours
• Deep Learning for Image Sequence Classification of Astronomical Events
• On Neural Architectures for Astronomical Time-series Classification with Application to Variable Stars
• Deep modeling of quasar variability
• Imbalance Learning for Variable Star Classification
• Unsupervised machine learning for transient discovery in Deeper, Wider, Faster light curves
• Deep Neural Network Classifier for Variable Stars with Novelty Detection Capability
• Real-Time Detection of Anomalies in Large-Scale Transient Surveys
• Classifying Image Sequences of Astronomical Transients with Deep Neural Networks
• Classification of Periodic Variable Stars with Novel Cyclic-Permutation Invariant Neural Networks
• Nonparametric Transient Classification using Adaptive Wavelets
• The effect of phased recurrent units in the classification of multiple catalogs of astronomical lightcurves
• A "Crib Sheet" for Supernova Events

Cited by in corpus (13)

• Towards an astronomical foundation model for stars with a Transformer-based model
• ASTROMER: A transformer-based embedding for the representation of light curves
• Persistent and occasional: searching for the variable population of the ZTF/4MOST sky using ZTF data release 11
• ATAT: Astronomical Transformer for time series And Tabular data
• Identifying Light-curve Signals with a Deep Learning Based Object Detection Algorithm. II. A General Light Curve Classification Framework
• Shedding Light on Low Surface Brightness Galaxies in Dark Energy Survey with Transformers
• Impact of Rubin Observatory cadence choices on supernovae photometric classification
• Transfer Learning for Transient Classification: From Simulations to Real Data and ZTF to LSST
• Testing and Combining Transient Spectral Classification Tools on 4MOST-like Blended Spectra
• Real-time Light Curve Classification Framework for the Wide Field Survey Telescope Using Modified Semi-supervised Variational Auto-Encoder
• Leveraging pre-trained vision Transformers for multi-band photometric light curve classification
• Uncertainty estimation for time series classification: Exploring predictive uncertainty in transformer-based models for variable stars
• Multivariate time series transformer embeddings for light curves of periodic variable stars