A data science platform to enable time-domain astronomy

Abstract

SkyPortal is an open-source software package designed to efficiently discover interesting transients, manage follow-up, perform characterization, and visualize the results. By enabling fast access to archival and catalog data, cross-matching heterogeneous data streams, and the triggering and monitoring of on-demand observations for further characterization, a SkyPortal-based platform has been operating at scale for 2 yr for the Zwicky Transient Facility Phase II community, with hundreds of users, containing tens of millions of time-domain sources, interacting with dozens of telescopes, and enabling community reporting. While SkyPortal emphasizes rich user experiences (UX) across common frontend workflows, recognizing that scientific inquiry is increasingly performed programmatically, SkyPortal also surfaces an extensive and well-documented API system. From backend and frontend software to data science analysis tools and visualization frameworks, the SkyPortal design emphasizes the re-use and leveraging of best-in-class approaches, with a strong extensibility ethos. For instance, SkyPortal now leverages ChatGPT large-language models (LLMs) to automatically generate and surface source-level human-readable summaries. With the imminent re-start of the next-generation of gravitational wave detectors, SkyPortal now also includes dedicated multi-messenger features addressing the requirements of rapid multi-messenger follow-up: multi-telescope management, team/group organizing interfaces, and cross-matching of multi-messenger data streams with time-domain optical surveys, with interfaces sufficiently intuitive for the newcomers to the field. (abridged)

arXiv commentAccepted to ApJS

References in corpus (86)

• GW170817: Observation of Gravitational Waves from a Binary Neutron Star Inspiral
• HEALPix -- a Framework for High Resolution Discretization, and Fast Analysis of Data Distributed on the Sphere
• Advanced Virgo: a 2nd generation interferometric gravitational wave detector
• Multi-messenger Observations of a Binary Neutron Star Merger
• Gravitational Waves and Gamma-rays from a Binary Neutron Star Merger: GW170817 and GRB 170817A
• LSST: from Science Drivers to Reference Design and Anticipated Data Products
• The generalised Lomb-Scargle periodogram. A new formalism for the floating-mean and Keplerian periodograms
• The Fermi Gamma-Ray Burst Monitor
• An Ordinary Short Gamma-Ray Burst with Extraordinary Implications: Fermi-GBM Detection of GRB 170817A
• Characterization of the LIGO detectors during their sixth science run
• The Zwicky Transient Facility: Data Processing, Products, and Archive
• ATLAS: A High-Cadence All-Sky Survey System
• A gravitational-wave standard siren measurement of the Hubble constant
• Swope Supernova Survey 2017a (SSS17a), the Optical Counterpart to a Gravitational Wave Source
• The Electromagnetic Counterpart of the Binary Neutron Star Merger LIGO/VIRGO GW170817. II. UV, Optical, and Near-IR Light Curves and Comparison to Kilonova Models
• Spectroscopic identification of r-process nucleosynthesis in a double neutron star merger
• INTEGRAL Detection of the First Prompt Gamma-Ray Signal Coincident with the Gravitational Wave Event GW170817
• A kilonova as the electromagnetic counterpart to a gravitational-wave source
• The Zwicky Transient Facility: Science Objectives
• The IceCube Neutrino Observatory: Instrumentation and Online Systems
• Optical emission from a kilonova following a gravitational-wave-detected neutron-star merger
• The Electromagnetic Counterpart of the Binary Neutron Star Merger LIGO/VIRGO GW170817. IV. Detection of Near-infrared Signatures of r-process Nucleosynthesis with Gemini-South
• Identification of strontium in the merger of two neutron stars
• The discovery of the electromagnetic counterpart of GW170817: kilonova AT 2017gfo/DLT17ck
• Kilonovae
• The Zwicky Transient Facility: Surveys and Scheduler
• Design and operation of the ATLAS Transient Science Server
• The Zwicky Transient Facility: Observing System
• The Zwicky Transient Facility Bright Transient Survey. II. A Public Statistical Sample for Exploring Supernova Demographics
• Gamma-Ray Burst Afterglows In The Multi-Messenger Era: Numerical Models and Closure Relations
• The SED Machine: a robotic spectrograph for fast transient classification
• MOSFiT: Modular Open-Source Fitter for Transients
• The Automatic Learning for the Rapid Classification of Events (ALeRCE) Alert Broker
• POSSIS: predicting spectra, light curves and polarization for multi-dimensional models of supernovae and kilonovae
• The first direct double neutron star merger detection: implications for cosmic nucleosynthesis
• Real-bogus classification for the Zwicky Transient Facility using deep learning
• Detectability of compact binary merger macronovae
• A Fully Automated Integral Field Spectrograph Pipeline for the SEDMachine: pysedm
• The Zwicky Transient Facility Alert Distribution System
• Machine Learning for the Zwicky Transient Facility
• GROWTH on S190425z: Searching thousands of square degrees to identify an optical or infrared counterpart to a binary neutron star merger with the Zwicky Transient Facility and Palomar Gattini IR
• The Katzman Automatic Imaging Telescope Gamma-Ray Burst Alert System, and Observations of GRB 020813
• Data-driven expectations for electromagnetic counterpart searches based on LIGO/Virgo public alerts
• Spitzer Mid-Infrared Detections of Neutron Star Merger GW170817 Suggests Synthesis of the Heaviest Elements
• GROWTH on S190814bv: Deep Synoptic Limits on the Optical/Near-Infrared Counterpart to a Neutron Star-Black Hole Merger
• Fink, a new generation of broker for the LSST community
• Searching for Electromagnetic Counterparts to Gravitational-wave Merger Events with the Prototype Gravitational-wave Optical Transient Observer (GOTO-4)
• A Morphological Classification Model to Identify Unresolved PanSTARRS1 Sources: Application in the ZTF Real-Time Pipeline
• Optical follow-up of the neutron star-black hole mergers S200105ae and S200115j
• Kilonova Luminosity Function Constraints based on Zwicky Transient Facility Searches for 13 Neutron Star Mergers
• Transient processing and analysis using $\text{AMPEL}$: Alert Management, Photometry and Evaluation of Lightcurves
• GRANDMA Observations of Advanced LIGO's and Advanced Virgo's Third Observational Campaign
• Implications of the search for optical counterparts during the first six months of the Advanced LIGO's and Advanced Virgo's third observing run: possible limits on the ejecta mass and binary properties
• Observational constraints on the optical and near-infrared emission from the neutron star-black hole binary merger S190814bv
• Fast-transient Searches in Real Time with ZTFReST: Identification of Three Optically-discovered Gamma-ray Burst Afterglows and New Constraints on the Kilonova Rate
• The first six months of the Advanced LIGO's and Advanced Virgo's third observing run with GRANDMA
• Palomar Gattini-IR: Survey overview, data processing system, on-sky performance and first results
• Optimizing searches for electromagnetic counterparts of gravitational wave triggers
• The critical role of nuclear heating rates, thermalization efficiencies and opacities for kilonova modelling and parameter inference
• The ANTARES Astronomical Time-Domain Event Broker
• Searches After Gravitational-waves Using ARizona Observatories (SAGUARO): System Overview and First Results from Advanced LIGO/Virgo's Third Observing Run
• A Galaxy-Targeted Search for the Optical Counterpart of the Candidate NS-BH Merger S190814bv with Magellan
• On standardizing kilonovae and their use as standard candles to measure the Hubble constant
• Implications of the search for optical counterparts during the second part of the Advanced LIGO's and Advanced Virgo's third observing run: lessons learned for future follow-up observations
• YSE-PZ: A Transient Survey Management Platform that Empowers the Human-in-the-Loop
• Teamwork Makes the Dream Work: Optimizing Multi-Telescope Observations of Gravitational-Wave Counterparts
• GROWTH on S190426c. II. Real-Time Search for a Counterpart to the Probable Neutron Star-Black Hole Merger using an Automated Difference Imaging Pipeline for DECam
• Constraining the Kilonova Rate with Zwicky Transient Facility Searches Independent of Gravitational Wave and Short Gamma-ray Burst Triggers
• Measuring the Hubble Constant with a sample of kilonovae
• The Gravitational Wave Treasure Map: A Tool to Coordinate, Visualize, and Assess the Electromagnetic Follow-Up of Gravitational Wave Events
• ZTF20aajnksq (AT2020blt): A Fast Optical Transient at $z\approx 2.9$ With No Detected Gamma-Ray Burst Counterpart
• $\text{simsurvey}$: Estimating Transient Discovery Rates for the Zwicky Transient Facility
• The wide-field infrared transient explorer (WINTER)
• 2900 square degree search for the optical counterpart of short gamma-ray burst GRB 180523B with the Zwicky Transient Facility
• GROWTH on S190510g: DECam Observation Planning and Follow-Up of a Distant Binary Neutron Star Merger Candidate
• The ZTF Source Classification Project: I. Methods and Infrastructure
• The ZTF Source Classification Project: II. Periodicity and variability processing metrics
• Towards a Real-time Transient Classification Engine
• IVOA Recommendation: Sky Event Reporting Metadata Version 2.0
• Astro-COLIBRI -- The COincidence LIBrary for Real-time Inquiry for multimessenger astrophysics
• GRANDMA Observations of ZTF/Fink Transients during Summer 2021
• Dynamic Scheduling: Target of Opportunity Observations of Gravitational Wave Events
• HEALPix Alchemy: Fast All-Sky Geometry and Image Arithmetic in a Relational Database for Multimessenger Astronomy Brokers
• Tails: Chasing Comets with the Zwicky Transient Facility and Deep Learning
• In search of short gamma-ray burst optical counterpart with the Zwicky Transient Facility
• Foraging with MUSHROOMS: A Mixed-Integer Linear Programming Scheduler for Multimessenger Target of Opportunity Searches with the Zwicky Transient Facility

Cited by in corpus (29)

• Towards an astronomical foundation model for stars with a Transformer-based model
• Minutes-duration Optical Flares with Supernova Luminosities
• Spectroscopic observations of progenitor activity 100 days before a Type Ibn supernova
• SN 2021adxl: A luminous nearby interacting supernova in an extremely low metallicity environment
• $\text{tdescore}$: An Accurate Photometric Classifier for Tidal Disruption Events
• Sample of hydrogen-rich superluminous supernovae from the Zwicky Transient Facility
• ZTF SN Ia DR2: The spectral diversity of Type Ia supernovae in a volume-limited sample
• Inferring CSM Properties of Type II SNe Using a Magnitude-Limited ZTF Sample
• Searching for late-time interaction signatures in Type Ia supernovae from the Zwicky Transient Facility
• SAGUARO: Time-domain Infrastructure for the Fourth Gravitational-wave Observing Run and Beyond
• SN 2022joj: A Peculiar Type Ia Supernova Possibly Driven by an Asymmetric Helium-shell Double Detonation
• ZTF SN Ia DR2: Properties of the low-mass host galaxies of Type Ia supernovae in a volume-limited sample
• A thermonuclear supernova interacting with hydrogen- and helium-deficient circumstellar material. SN 2020aeuh as a SN Ia-CSM-C/O?
• Eruptive mass loss less than a year before the explosion of superluminous supernovae: I. The cases of SN 2020xga and SN 2022xgc
• WINTER on S250206dm: A near-infrared search for an electromagnetic counterpart to a gravitational-wave event
• Four new eclipsing accreting ultracompact white dwarf binaries found with the Zwicky Transient Facility
• The automation of optical transient discovery and classification in Rubin-era time-domain astronomy
• A Broker Integrated Algorithm for Gravitational Wave - Electromagnetic Counterpart Searches in O4a and O4b Runs
• ZTF-observed late-time signals of pre-ZTF transients
• FALCO: a Foundation model of Astronomical Light Curves for time dOmain astronomy
• RADAR-Radio Afterglow Detection and AI-driven Response: A Federated Framework for Gravitational Wave Event Follow-Up
• Machine-directed gravitational-wave counterpart discovery
• ZTF SN~Ia DR2: Cosmology-independent constraints on Type Ia supernova standardisation from supernova siblings
• A real-time search for Type Ia Supernovae with late-time CSM interaction in ZTF
• TDE 2025abcr: A Tidal Disruption Event in the Outskirts of a Massive Galaxy
• Large Language Model-driven Analysis of General Coordinates Network (GCN) Circulars
• Encapsulating Textual Contents into a MOC data Structure for Advanced Applications
• The nearby He-rich superluminous supernova SN 2021bnw during photospheric phases
• AT2024lhc and AT2024kmq in the landscape of featureless tidal disruption events