Transient processing and analysis using $\text{AMPEL}$: Alert Management, Photometry and Evaluation of Lightcurves

Abstract

Both multi-messenger astronomy and new high-throughput wide-field surveys require flexible tools for the selection and analysis of astrophysical transients. We here introduce the Alert Management, Photometry and Evaluation of Lightcurves (AMPEL) system, an analysis framework designed for high-throughput surveys and suited for streamed data. AMPEL combines the functionality of an alert broker with a generic framework capable of hosting user-contributed code, that encourages provenance and keeps track of the varying information states that a transient displays. The latter concept includes information gathered over time and data policies such as access or calibration levels. We describe a novel ongoing real-time multi-messenger analysis using AMPEL to combine IceCube neutrino data with the alert streams of the Zwicky Transient Facility (ZTF). We also reprocess the first four months of ZTF public alerts, and compare the yields of more than 200 different transient selection functions to quantify efficiencies for selecting Type Ia supernovae that were reported to the Transient Name Server (TNS). We highlight three channels suitable for (1) the collection of a complete sample of extragalactic transients, (2) immediate follow-up of nearby transients and (3) follow-up campaigns targeting young, extragalactic transients. We confirm ZTF completeness in that all TNS supernovae positioned on active CCD regions were detected. AMPEL can assist in filtering transients in real time, running alert reaction simulations, the reprocessing of full datasets as well as in the final scientific analysis of transient data. This text introduces how users can design their own channels for inclusion in the AMPEL live instance that parses the ZTF stream and the real-time submission of high quality extragalactic supernova candidates to the TNS.

Updated to match version accepted for publication in A&A

References in corpus (31)

• Astropy: A Community Python Package for Astronomy
• Gaia Data Release 2. Summary of the contents and survey properties
• Binary companions of evolved stars in APOGEE DR14: Search method and catalog of ~5,000 companions
• Multi-messenger Observations of a Binary Neutron Star Merger
• The Zwicky Transient Facility: System Overview, Performance, and First Results
• Improved cosmological constraints from a joint analysis of the SDSS-II and SNLS supernova samples
• Evidence for High-Energy Extraterrestrial Neutrinos at the IceCube Detector
• First Results from the Catalina Real-time Transient Survey
• The Zwicky Transient Facility: Data Processing, Products, and Archive
• Multi-messenger observations of a flaring blazar coincident with high-energy neutrino IceCube-170922A
• The Zwicky Transient Facility: Science Objectives
• COSMOLOGICAL GAMMA RAY BURSTS AND THE HIGHEST ENERGY COSMIC RAYS
• The Sloan Digital Sky Survey Quasar Catalog: twelfth data release
• TeV-PeV Neutrinos from Low-Power Gamma-Ray Burst Jets inside Stars
• Neutral Beams from Blazar Jets
• High-Energy Neutrinos from Photomeson Processes in Blazars
• The IceCube Realtime Alert System
• Choked Jets and Low-Luminosity Gamma-Ray Bursts as Hidden Neutrino Sources
• Photohadronic origin of $\gamma$-ray BL Lac emission: implications for IceCube neutrinos
• The Half Million Quasars (HMQ) Catalogue
• Giant AGN Flares and Cosmic Ray Bursts
• The GROWTH Marshal: A Dynamic Science Portal for Time-Domain Astronomy
• The Zwicky Transient Facility Alert Distribution System
• Machine Learning for the Zwicky Transient Facility
• The Astrophysical Multimessenger Observatory Network (AMON)
• A Morphological Classification Model to Identify Unresolved PanSTARRS1 Sources: Application in the ZTF Real-Time Pipeline
• High Energy Neutrinos from the Tidal Disruption of Stars
• Can tidal disruption events produce the IceCube neutrinos?
• High-Energy Neutrino Flares From X-Ray Bright and Dark Tidal Disruptions Events
• catsHTM - A tool for fast accessing and cross-matching large astronomical catalogs
• $\text{simsurvey}$: Estimating Transient Discovery Rates for the Zwicky Transient Facility

Cited by in corpus (70)

• Seventeen Tidal Disruption Events from the First Half of ZTF Survey Observations: Entering a New Era of Population Studies
• The Zwicky Transient Facility Bright Transient Survey. II. A Public Statistical Sample for Exploring Supernova Demographics
• A tidal disruption event coincident with a high-energy neutrino
• The Automatic Learning for the Rapid Classification of Events (ALeRCE) Alert Broker
• Discovery and confirmation of the shortest gamma ray burst from a collapsar
• Candidate Tidal Disruption Event AT2019fdr Coincident with a High-Energy Neutrino
• Bright, months-long stellar outbursts announce the explosion of interaction-powered supernovae
• The Zwicky Transient Facility Census of the Local Universe I: Systematic search for Calcium rich gap transients reveal three related spectroscopic sub-classes
• Fink, a new generation of broker for the LSST community
• Optical follow-up of the neutron star-black hole mergers S200105ae and S200115j
• Kilonova Luminosity Function Constraints based on Zwicky Transient Facility Searches for 13 Neutron Star Mergers
• A Search for Extragalactic Fast Blue Optical Transients in ZTF and the Rate of AT2018cow-like Transients
• The prevalence and influence of circumstellar material around hydrogen-rich supernova progenitors
• A data science platform to enable time-domain astronomy
• Fast-transient Searches in Real Time with ZTFReST: Identification of Three Optically-discovered Gamma-ray Burst Afterglows and New Constraints on the Kilonova Rate
• A Family Tree of Optical Transients from Narrow-Line Seyfert 1 Galaxies
• The ANTARES Astronomical Time-Domain Event Broker
• The Tidal Disruption Event AT2021ehb: Evidence of Relativistic Disk Reflection, and Rapid Evolution of the Disk-Corona System
• Alert Classification for the ALeRCE Broker System: The Real-time Stamp Classifier
• Establishing accretion flares from massive black holes as a source of high-energy neutrinos
• YSE-PZ: A Transient Survey Management Platform that Empowers the Human-in-the-Loop
• Strong gravitational lensing and microlensing of supernovae
• The Young Supernova Experiment Data Release 1 (YSE DR1): Light Curves and Photometric Classification of 1975 Supernovae
• Variability-selected intermediate mass black hole candidates in dwarf galaxies from ZTF and WISE
• A Systematic Study of Ia-CSM Supernovae from the ZTF Bright Transient Survey
• Searches after Gravitational Waves Using ARizona Observatories (SAGUARO): Observations and Analysis from Advanced LIGO/Virgo's Third Observing Run
• The SNAD Viewer: Everything You Want to Know about Your Favorite ZTF Object
• Fink: early supernovae Ia classification using active learning
• AGN on the move: A search for off-nuclear AGN from recoiling SMBHs and ongoing galaxy mergers with the Zwicky Transient Facility
• Optimizing Serendipitous Detections of Kilonovae: Cadence and Filter Selection
• SNIascore: Deep Learning Classification of Low-Resolution Supernova Spectra
• Neutrino follow-up with the Zwicky Transient Facility: Results from the first 24 campaigns
• Real-Time Value-Driven Data Augmentation in the Era of LSST
• Persistent and occasional: searching for the variable population of the ZTF/4MOST sky using ZTF data release 11
• Type II-P Supernova Progenitor Star Initial Masses and SN 2020jfo: Direct Detection, Light Curve Properties, Nebular Spectroscopy, and Local Environment
• Astro-COLIBRI -- The COincidence LIBrary for Real-time Inquiry for multimessenger astrophysics
• ATAT: Astronomical Transformer for time series And Tabular data
• Supernova Siblings and their Parent Galaxies in the Zwicky Transient Facility Bright Transient Surve
• $\text{tdescore}$: An Accurate Photometric Classifier for Tidal Disruption Events
• The H.E.S.S. transients follow-up system
• Enabling the discovery of fast transients: A kilonova science module for the Fink broker
• TiDES: The 4MOST Time Domain Extragalactic Survey
• HEALPix Alchemy: Fast All-Sky Geometry and Image Arithmetic in a Relational Database for Multimessenger Astronomy Brokers
• Deep Drilling in the Time Domain with DECam: Survey Characterization
• AT2018lqh and the nature of the emerging population of day-scale duration optical transients
• DELIGHT: Deep Learning Identification of Galaxy Hosts of Transients using Multi-resolution Images
• Transient Classifiers for Fink: Benchmarks for LSST
• SN 2020udy: a SN Iax with strict limits on interaction consistent with a helium-star companion
• Prospects for extending the core-collapse supernova detection horizon using high-energy neutrinos
• AT 2019abn: multi-wavelength observations over the first 200 days
• In search of short gamma-ray burst optical counterpart with the Zwicky Transient Facility
• Flaires: A Comprehensive Catalog of Dust-Echo-like Infrared Flares
• SAGUARO: Time-domain Infrastructure for the Fourth Gravitational-wave Observing Run and Beyond
• SNGuess: A method for the selection of young extragalactic transients
• Astro-COLIBRI 2 -- an advanced platform for real-time multi-messenger discoveries
• The Atacama Cosmology Telescope: Flux Upper Limits from a Targeted Search for Extragalactic Transients
• AT 2020iko: a WZ Sge-type DN candidate with an anomalous precursor event
• Early Identification of Optical Tidal Disruption Events: A science module for the Fink broker
• ELEPHANT: ExtragaLactic alErt Pipeline for Hostless AstroNomical Transients
• Multi-messenger connection in high-energy neutrino astronomy
• Multi-scale stamps for real-time classification of alert streams
• Real-Time Active Learning for optimised spectroscopic follow-up: Enhancing early SN Ia classification with the Fink broker
• The automation of optical transient discovery and classification in Rubin-era time-domain astronomy
• RADAR-Radio Afterglow Detection and AI-driven Response: A Federated Framework for Gravitational Wave Event Follow-Up
• Candidate strongly lensed type Ia supernovae in the Zwicky Transient Facility archive
• Machine-directed gravitational-wave counterpart discovery
• AMPEL workflows for LSST: Modular and reproducible real-time photometric classification
• Early Detection of Multiwavelength Blazar Variability
• Neutrinos from extreme astrophysical sources
• TransientVerse: A Comprehensive Real-Time Alert and Multi-Wavelength Analysis System for Transient Astronomical Events