Real-Time Detection of Anomalies in Large-Scale Transient Surveys

Abstract

New time-domain surveys, such as the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST), will observe millions of transient alerts each night, making standard approaches of visually identifying new and interesting transients infeasible. We present two novel methods of automatically detecting anomalous transient light curves in real-time. Both methods are based on the simple idea that if the light curves from a known population of transients can be accurately modelled, any deviations from model predictions are likely anomalies. The first modelling approach is a probabilistic neural network built using Temporal Convolutional Networks (TCNs) and the second is an interpretable Bayesian parametric model of a transient. We demonstrate our methods' ability to provide anomaly scores as a function of time on light curves from the Zwicky Transient Facility. We show that the flexibility of neural networks, the attribute that makes them such a powerful tool for many regression tasks, is what makes them less suitable for anomaly detection when compared with our parametric model. The parametric model is able to identify anomalies with respect to common supernova classes with high precision and recall scores, achieving area under the precision-recall curves (AUCPR) above 0.79 for most rare classes such as kilonovae, tidal disruption events, intermediate luminosity transients, and pair-instability supernovae. Our ability to identify anomalies improves over the lifetime of the light curves. Our framework, used in conjunction with transient classifiers, will enable fast and prioritised followup of unusual transients from new large-scale surveys.

arXiv comment27 pages, 23 figures, accepted for publication in MNRAS

References in corpus (41)

• GW170817: Observation of Gravitational Waves from a Binary Neutron Star Inspiral
• An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
• The Transiting Exoplanet Survey Satellite
• LSST: from Science Drivers to Reference Design and Anticipated Data Products
• Correcting for the Effects of Interstellar Extinction
• The Zwicky Transient Facility: System Overview, Performance, and First Results
• The Zwicky Transient Facility: Science Objectives
• Exploring the Optical Transient Sky with the Palomar Transient Factory
• SNANA: A Public Software Package for Supernova Analysis
• Photometric Supernova Classification With Machine Learning
• SuperNNova: an open-source framework for Bayesian, Neural Network based supernova classification
• RAPID: Early Classification of Explosive Transients using Deep Learning
• Models and Simulations for the Photometric LSST Astronomical Time Series Classification Challenge (PLAsTiCC)
• The Core-collapse rate from the Supernova Legacy Survey
• A recurrent neural network for classification of unevenly sampled variable stars
• A mildly relativistic outflow from the energetic, fast-rising blue optical transient CSS161010 in a dwarf galaxy
• Avocado: Photometric Classification of Astronomical Transients with Gaussian Process Augmentation
• Deep Recurrent Neural Networks for Supernovae Classification
• Machine Learning-based Brokers for Real-time Classification of the LSST Alert Stream
• Deeply Uncertain: Comparing Methods of Uncertainty Quantification in Deep Learning Algorithms
• Astronomaly: Personalised Active Anomaly Detection in Astronomical Data
• Anomaly detection in the Zwicky Transient Facility DR3
• Dropout as a Bayesian Approximation: Appendix
• Delayed Circumstellar Interaction for Type Ia SN 2015cp Revealed by an HST Ultraviolet Imaging Survey
• PELICAN: deeP architecturE for the LIght Curve ANalysis
• Systematic Serendipity: A Test of Unsupervised Machine Learning as a Method for Anomaly Detection
• Type Ia Supernova Sub-classes and Progenitor Origin
• Supervised detection of anomalous light-curves in massive astronomical catalogs
• A Deep Learning Approach for Active Anomaly Detection of Extragalactic Transients
• GHOST: Using Only Host Galaxy Information to Accurately Associate and Distinguish Supernovae
• Active Anomaly Detection for time-domain discoveries
• On Neural Architectures for Astronomical Time-series Classification with Application to Variable Stars
• Anomaly Detection in the Open Supernova Catalog
• The Photometric LSST Astronomical Time-series Classification Challenge (PLAsTiCC): Data set
• Classifying Supernovae Using Only Galaxy Data
• Unsupervised machine learning for transient discovery in Deeper, Wider, Faster light curves
• Automated novelty detection in the WISE survey with one-class support vector machines
• A method for finding anomalous astronomical light curves and their analogs
• Improved Photometric Classification of Supernovae using Deep Learning
• A classification algorithm for time-domain novelties in preparation for LSST alerts: Application to variable stars and transients detected with DECam in the Galactic Bulge
• Deep Generative Modeling of Periodic Variable Stars Using Physical Parameters

Cited by in corpus (16)

• Deep Attention-Based Supernovae Classification of Multi-Band Light-Curves
• The ROAD to discovery: machine learning-driven anomaly detection in radio astronomy spectrograms
• SNAD Transient Miner: Finding Missed Transient Events in ZTF DR4 using k-D trees
• Understanding of the properties of neural network approaches for transient light curve approximations
• A Classifier-Based Approach to Multi-Class Anomaly Detection for Astronomical Transients
• Representation Learning for Time-Domain High-Energy Astrophysics: Discovery of Extragalactic Fast X-ray Transient XRT 200515
• Deep Learning and LLM-based Methods Applied to Stellar Lightcurve Classification
• Transfer Learning for Transient Classification: From Simulations to Real Data and ZTF to LSST
• Finding radio transients with anomaly detection and active learning based on volunteer classifications
• Searching for Quasi-Periodic Eruptions using Machine Learning
• Anomaly Detection to identify Transients in LSST Time Series Data
• Real-time Light Curve Classification Framework for the Wide Field Survey Telescope Using Modified Semi-supervised Variational Auto-Encoder
• Quantum Machine Learning for Identifying Transient Events in X-ray Light Curves
• J-PLUS: Understanding outlier white dwarfs in the third data release via dimensionality reduction
• Extracting latent representations from X-ray spectra. Classification, regression, and accretion signatures of Chandra sources
• Enabling New Discoveries with Machine Learning