Real-bogus scores for active anomaly detection

Abstract

In the task of anomaly detection in modern time-domain photometric surveys, the primary goal is to identify astrophysically interesting, rare, and unusual objects among a large volume of data. Unfortunately, artifacts -- such as plane or satellite tracks, bad columns on CCDs, and ghosts -- often constitute significant contaminants in results from anomaly detection analysis. In such contexts, the Active Anomaly Discovery (AAD) algorithm allows tailoring the output of anomaly detection pipelines according to what the expert judges to be scientifically interesting. We demonstrate how the introduction real-bogus scores, obtained from a machine learning classifier, improves the results from AAD. Using labeled data from the SNAD ZTF knowledge database, we train four real-bogus classifiers: XGBoost, CatBoost, Random Forest, and Extremely Randomized Trees. All the models perform real-bogus classification with similar effectiveness, achieving ROC-AUC scores ranging from 0.93 to 0.95. Consequently, we select the Random Forest model as the main model due to its simplicity and interpretability. The Random Forest classifier is applied to 67 million light curves from ZTF DR17. The output real-bogus score is used as an additional feature for two anomaly detection algorithms: static Isolation Forest and AAD. While results from Isolation Forest remained unchanged, the number of artifacts detected by the active approach decreases significantly with the inclusion of the real-bogus score, from 27 to 3 out of 100. We conclude that incorporating the real-bogus classifier result as an additional feature in the active anomaly detection pipeline significantly reduces the number of artifacts in the outputs, thereby increasing the incidence of astrophysically interesting objects presented to human experts.

9 pages, 5 figures, 3 tables

References in corpus (21)

• The Zwicky Transient Facility: System Overview, Performance, and First Results
• CatBoost: gradient boosting with categorical features support
• ATLAS: A High-Cadence All-Sky Survey System
• The Zwicky Transient Facility Catalog of Periodic Variable Stars
• Real-bogus classification for the Zwicky Transient Facility using deep learning
• Automated Transient Identification in the Dark Energy Survey
• The Core-collapse rate from the Supernova Legacy Survey
• Machine Learning in Astronomy: a practical overview
• Using Machine Learning for Discovery in Synoptic Survey Imaging
• Machine learning for transient discovery in Pan-STARRS1 difference imaging
• How to Find More Supernovae with Less Work: Object Classification Techniques for Difference Imaging
• Anomaly detection in the Zwicky Transient Facility DR3
• Searching for changing-state AGNs in massive datasets -- I: applying deep learning and anomaly detection techniques to find AGNs with anomalous variability behaviours
• Active Anomaly Detection for time-domain discoveries
• Incorporating Feedback into Tree-based Anomaly Detection
• The SNAD Viewer: Everything You Want to Know about Your Favorite ZTF Object
• What's the Difference? The potential for Convolutional Neural Networks for transient detection without template subtraction
• Supernova search with active learning in ZTF DR3
• SNAD Transient Miner: Finding Missed Transient Events in ZTF DR4 using k-D trees
• SNAD catalogue of M-dwarf flares from the Zwicky Transient Facility
• A Pilot Search for Gravitational Self-Lensing Binaries with the Zwicky Transient Facility

Cited by in corpus (1)

• Interpreting anomaly detection of SDSS spectra