Real-Time Value-Driven Data Augmentation in the Era of LSST

Abstract

The deluge of data from time-domain surveys is rendering traditional human-guided data collection and inference techniques impractical. We propose a novel approach for conducting data collection for science inference in the era of massive large-scale surveys that uses value-based metrics to autonomously strategize and co-ordinate follow-up in real-time. We demonstrate the underlying principles in the Recommender Engine For Intelligent Transient Tracking (REFITT) that ingests live alerts from surveys and value-added inputs from data brokers to predict the future behavior of transients and design optimal data augmentation strategies given a set of scientific objectives. The prototype presented in this paper is tested to work given simulated Rubin Observatory Legacy Survey of Space and Time (LSST) core-collapse supernova (CC SN) light-curves from the PLAsTiCC dataset. CC SNe were selected for the initial development phase as they are known to be difficult to classify, with the expectation that any learning techniques for them should be at least as effective for other transients. We demonstrate the behavior of REFITT on a random LSST night given ~32000 live CC SNe of interest. The system makes good predictions for the photometric behavior of the events and uses them to plan follow-up using a simple data-driven metric. We argue that machine-directed follow-up maximizes the scientific potential of surveys and follow-up resources by reducing downtime and bias in data collection.

arXiv commentPublished in The Astrophysical Journal

References in corpus (33)

• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• Deep Residual Learning for Image Recognition
• LSST: from Science Drivers to Reference Design and Anticipated Data Products
• ATLAS: A High-Cadence All-Sky Survey System
• Las Cumbres Observatory Global Telescope Network
• The All-Sky Automated Survey for Supernovae (ASAS-SN) Light Curve Server v1.0
• The Zwicky Transient Facility: Science Objectives
• The discovery of the electromagnetic counterpart of GW170817: kilonova AT 2017gfo/DLT17ck
• An embedded X-ray source shines through the aspherical AT2018cow: revealing the inner workings of the most luminous fast-evolving optical transients
• Large Synoptic Survey Telescope: Overview
• The Fast, Luminous Ultraviolet Transient AT2018cow: Extreme Supernova, or Disruption of a Star by an Intermediate-Mass Black Hole?
• SuperNNova: an open-source framework for Bayesian, Neural Network based supernova classification
• Forecasting Solar Flares Using Magnetogram-based Predictors and Machine Learning
• The GROWTH Marshal: A Dynamic Science Portal for Time-Domain Astronomy
• Rapidly Rising Transients in the Supernova - Superluminous Supernova Gap
• RAPID: Early Classification of Explosive Transients using Deep Learning
• Models and Simulations for the Photometric LSST Astronomical Time Series Classification Challenge (PLAsTiCC)
• LOSS Revisited - II: The relative rates of different types of supernovae vary between low- and high-mass galaxies
• Avocado: Photometric Classification of Astronomical Transients with Gaussian Process Augmentation
• Transient processing and analysis using $\text{AMPEL}$: Alert Management, Photometry and Evaluation of Lightcurves
• Machine Learning-based Brokers for Real-time Classification of the LSST Alert Stream
• First Cosmology Results Using Type Ia Supernovae From the Dark Energy Survey: Photometric Pipeline and Light Curve Data Release
• Enabling real-time multi-messenger astrophysics discoveries with deep learning
• Two New Calcium-Rich Gap Transients in Group and Cluster Environments
• Optimizing spectroscopic follow-up strategies for supernova photometric classification with active learning
• Spectrophotometric templates for core collapse supernovae and their application in simulations of time-domain surveys
• The unblinking eye on the sky
• Deep Learning for Image Sequence Classification of Astronomical Events
• The Photometric LSST Astronomical Time-series Classification Challenge (PLAsTiCC): Data set
• ANTARES: A Prototype Transient Broker System
• Ground motion prediction at gravitational wave observatories using archival seismic data
• The Zwicky Transient Facility Bright Transient Survey I: Spectroscopic Classification and the Redshift Completeness of Local Galaxy Catalogs
• Photometric light curves classification with machine learning

Cited by in corpus (13)

• SNEWS 2.0: A Next-Generation SuperNova Early Warning System for Multi-messenger Astronomy
• SuperRAENN: A Semi-supervised Supernova Photometric Classification Pipeline Trained on Pan-STARRS1 Medium Deep Survey Supernovae
• Fast-transient Searches in Real Time with ZTFReST: Identification of Three Optically-discovered Gamma-ray Burst Afterglows and New Constraints on the Kilonova Rate
• GHOST: Using Only Host Galaxy Information to Accurately Associate and Distinguish Supernovae
• Photometric Classification of 2315 Pan-STARRS1 Supernovae with Superphot
• Inferencing Progenitor and Explosion Properties of Evolving Core-collapse Supernovae from Zwicky Transient Facility Light Curves
• Red Supergiant Candidates for Multimessenger Monitoring of the Next Galactic Supernova
• Star formation and morphological properties of galaxies in the Pan-STARRS $3\pi$ survey- I. A machine learning approach to galaxy and supernova classification
• Scary Barbie: An Extremely Energetic, Long-Duration Tidal Disruption Event Candidate Without a Detected Host Galaxy at z = 0.995
• Exploring GRBs and supernovae connection: does a superluminous hypernova population exist?
• Machine-directed gravitational-wave counterpart discovery
• Supernova host galaxy association and photometric classification of over 10,000 light curves from the Zwicky Transient Facility
• Informative regularization for a multi-layer perceptron RR Lyrae classifier under data shift