SNAD Transient Miner: Finding Missed Transient Events in ZTF DR4 using k-D trees

Abstract

We report the automatic detection of 11 transients (7 possible supernovae and 4 active galactic nuclei candidates) within the Zwicky Transient Facility fourth data release (ZTF DR4), all of them observed in 2018 and absent from public catalogs. Among these, three were not part of the ZTF alert stream. Our transient mining strategy employs 41 physically motivated features extracted from both real light curves and four simulated light curve models (SN Ia, SN II, TDE, SLSN-I). These features are input to a k-D tree algorithm, from which we calculate the 15 nearest neighbors. After pre-processing and selection cuts, our dataset contained approximately a million objects among which we visually inspected the 105 closest neighbors from seven of our brightest, most well-sampled simulations, comprising 89 unique ZTF DR4 sources. Our result illustrates the potential of coherently incorporating domain knowledge and automatic learning algorithms, which is one of the guiding principles directing the SNAD team. It also demonstrates that the ZTF DR is a suitable testing ground for data mining algorithms aiming to prepare for the next generation of astronomical data.

arXiv comment30 pages, 5 figures, 3 tables, preprint accepted to New Astronomy

References in corpus (47)

• Scikit-learn: Machine Learning in Python
• Observational Evidence from Supernovae for an Accelerating Universe and a Cosmological Constant
• Measurements of Omega and Lambda from 42 High-Redshift Supernovae
• Astropy: A Community Python Package for Astronomy
• The NumPy array: a structure for efficient numerical computation
• The Astropy Project: Building an inclusive, open-science project and status of the v2.0 core package
• The SIMBAD astronomical database
• The Zwicky Transient Facility: System Overview, Performance, and First Results
• The Sixteenth Data Release of the Sloan Digital Sky Surveys: First Release from the APOGEE-2 Southern Survey and Full Release of eBOSS Spectra
• LSST Science Book, Version 2.0
• The Zwicky Transient Facility: Science Objectives
• A First Catalog of Variable Stars Measured by the Asteroid Terrestrial-impact Last Alert System (ATLAS)
• SNANA: A Public Software Package for Supernova Analysis
• The Zwicky Transient Facility Catalog of Periodic Variable Stars
• Photometric Supernova Classification With Machine Learning
• UPMASK: unsupervised photometric membership assignment in stellar clusters
• Results from the Supernova Photometric Classification Challenge
• Absolute-Magnitude Distributions of Supernovae
• RAPID: Early Classification of Explosive Transients using Deep Learning
• Models and Simulations for the Photometric LSST Astronomical Time Series Classification Challenge (PLAsTiCC)
• Avocado: Photometric Classification of Astronomical Transients with Gaussian Process Augmentation
• Fink, a new generation of broker for the LSST community
• The Young Supernova Experiment: Survey Goals, Overview, and Operations
• The EPOCH Project: I. Periodic variable stars in the EROS-2 LMC database
• SuperRAENN: A Semi-supervised Supernova Photometric Classification Pipeline Trained on Pan-STARRS1 Medium Deep Survey Supernovae
• Astronomaly: Personalised Active Anomaly Detection in Astronomical Data
• Optimizing spectroscopic follow-up strategies for supernova photometric classification with active learning
• The ANTARES Astronomical Time-Domain Event Broker
• pyUPMASK: an improved unsupervised clustering algorithm
• Anomaly detection in the Zwicky Transient Facility DR3
• An analysis of feature relevance in the classification of astronomical transients with machine learning methods
• Radio Galaxy Zoo: Unsupervised Clustering of Convolutionally Auto-encoded Radio-astronomical Images
• PELICAN: deeP architecturE for the LIght Curve ANalysis
• A Deep Learning Approach for Active Anomaly Detection of Extragalactic Transients
• Near Infrared Variability of obscured and unobscured X-ray selected AGN in the COSMOS field
• The Zwicky Transient Facility Type Ia supernova survey: first data release and results
• Active Anomaly Detection for time-domain discoveries
• Anomaly Detection in the Open Supernova Catalog
• Anomaly detection in Hyper Suprime-Cam galaxy images with generative adversarial networks
• Light curve classification with recurrent neural networks for GOTO: dealing with imbalanced data
• Real-Time Detection of Anomalies in Large-Scale Transient Surveys
• A method for finding anomalous astronomical light curves and their analogs
• Classification of Multiwavelength Transients with Machine Learning
• Data-driven detection of multi-messenger transients
• The Optical Gravitational Lensing Experiment. The OGLE-III Catalog of Variable Stars. I. Classical Cepheids in the Large Magellanic Cloud
• El-CID: A filter for Gravitational-wave Electromagnetic Counterpart Identification
• Considerations for optimizing photometric classification of supernovae from the Rubin Observatory

Cited by in corpus (6)

• The Young Supernova Experiment Data Release 1 (YSE DR1): Light Curves and Photometric Classification of 1975 Supernovae
• The SNAD Viewer: Everything You Want to Know about Your Favorite ZTF Object
• Persistent and occasional: searching for the variable population of the ZTF/4MOST sky using ZTF data release 11
• Supernova search with active learning in ZTF DR3
• Real-bogus scores for active anomaly detection
• Exploring the Universe with SNAD: Anomaly Detection in Astronomy