SNAD Transient Miner: Finding Missed Transient Events in ZTF DR4 using k-D trees

Abstract

We report the automatic detection of 11 transients (7 possible supernovae and 4 active galactic nuclei candidates) within the Zwicky Transient Facility fourth data release (ZTF DR4), all of them observed in 2018 and absent from public catalogs. Among these, three were not part of the ZTF alert stream. Our transient mining strategy employs 41 physically motivated features extracted from both real light curves and four simulated light curve models (SN Ia, SN II, TDE, SLSN-I). These features are input to a k-D tree algorithm, from which we calculate the 15 nearest neighbors. After pre-processing and selection cuts, our dataset contained approximately a million objects among which we visually inspected the 105 closest neighbors from seven of our brightest, most well-sampled simulations, comprising 89 unique ZTF DR4 sources. Our result illustrates the potential of coherently incorporating domain knowledge and automatic learning algorithms, which is one of the guiding principles directing the SNAD team. It also demonstrates that the ZTF DR is a suitable testing ground for data mining algorithms aiming to prepare for the next generation of astronomical data.

30 pages, 5 figures, 3 tables, preprint accepted to New Astronomy

References in corpus (26)

• The NumPy array: a structure for efficient numerical computation
• The Zwicky Transient Facility: System Overview, Performance, and First Results
• The Zwicky Transient Facility: Science Objectives
• The Zwicky Transient Facility Catalog of Periodic Variable Stars
• Results from the Supernova Photometric Classification Challenge
• Absolute-Magnitude Distributions of Supernovae
• Fink, a new generation of broker for the LSST community
• The Young Supernova Experiment: Survey Goals, Overview, and Operations
• The EPOCH Project: I. Periodic variable stars in the EROS-2 LMC database
• SuperRAENN: A Semi-supervised Supernova Photometric Classification Pipeline Trained on Pan-STARRS1 Medium Deep Survey Supernovae
• Astronomaly: Personalised Active Anomaly Detection in Astronomical Data
• The ANTARES Astronomical Time-Domain Event Broker
• pyUPMASK: an improved unsupervised clustering algorithm
• Anomaly detection in the Zwicky Transient Facility DR3
• PELICAN: deeP architecturE for the LIght Curve ANalysis
• A Deep Learning Approach for Active Anomaly Detection of Extragalactic Transients
• Near Infrared Variability of obscured and unobscured X-ray selected AGN in the COSMOS field
• The Zwicky Transient Facility Type Ia supernova survey: first data release and results
• Anomaly detection in Hyper Suprime-Cam galaxy images with generative adversarial networks
• Light curve classification with recurrent neural networks for GOTO: dealing with imbalanced data
• Real-Time Detection of Anomalies in Large-Scale Transient Surveys
• A method for finding anomalous astronomical light curves and their analogs
• Data-driven detection of multi-messenger transients
• The Optical Gravitational Lensing Experiment. The OGLE-III Catalog of Variable Stars. I. Classical Cepheids in the Large Magellanic Cloud
• El-CID: A filter for Gravitational-wave Electromagnetic Counterpart Identification
• Considerations for optimizing photometric classification of supernovae from the Rubin Observatory

Cited by in corpus (6)

• The Young Supernova Experiment Data Release 1 (YSE DR1): Light Curves and Photometric Classification of 1975 Supernovae
• The SNAD Viewer: Everything You Want to Know about Your Favorite ZTF Object
• Persistent and occasional: searching for the variable population of the ZTF/4MOST sky using ZTF data release 11
• Supernova search with active learning in ZTF DR3
• Real-bogus scores for active anomaly detection
• Exploring the Universe with SNAD: Anomaly Detection in Astronomy