Anomaly Detection in the Open Supernova Catalog
arXiv:1905.11516 · doi:10.1093/mnras/stz2362
Abstract
In the upcoming decade large astronomical surveys will discover millions of transients raising unprecedented data challenges in the process. Only the use of the machine learning algorithms can process such large data volumes. Most of the discovered transients will belong to the known classes of astronomical objects. However, it is expected that some transients will be rare or completely new events of unknown physical nature. The task of finding them can be framed as an anomaly detection problem. In this work, we perform for the first time an automated anomaly detection analysis in the photometric data of the Open Supernova Catalog (OSC), which serves as a proof of concept for the applicability of these methods to future large scale surveys. The analysis consists of the following steps: 1) data selection from the OSC and approximation of the pre-processed data with Gaussian processes, 2) dimensionality reduction, 3) searching for outliers with the use of the isolation forest algorithm, 4) expert analysis of the identified outliers. The pipeline returned 81 candidate anomalies, 27 (33%) of which were confirmed to be from astrophysically peculiar objects. Found anomalies correspond to a selected sample of 1.4% of the initial automatically identified data sample of ~2000 objects. Among the identified outliers we recognised superluminous supernovae, non-classical Type Ia supernovae, unusual Type II supernovae, one active galactic nucleus and one binary microlensing event. We also found that 16 anomalies classified as supernovae in the literature are likely to be quasars or stars. Our proposed pipeline represents an effective strategy to guarantee we shall not overlook exciting new science hidden in the data we fought so hard to acquire. All code and products of this investigation are made publicly available.
arXiv comment18 pages, 19 figures, accepted in MNRAS
References in corpus (87)
- Scikit-learn: Machine Learning in Python
- Measurements of Omega and Lambda from 42 High-Redshift Supernovae
- The NumPy array: a structure for efficient numerical computation
- The Complete Light-curve Sample of Spectroscopically Confirmed Type Ia Supernovae from Pan-STARRS1 and Cosmological Constraints from The Combined Pantheon Sample
- The Supernova Legacy Survey: Measurement of Omega_M, Omega_Lambda and w from the First Year Data Set
- The Zwicky Transient Facility: System Overview, Performance, and First Results
- Improved cosmological constraints from a joint analysis of the SDSS-II and SNLS supernova samples
- SparsePak: A Formatted Fiber Field Unit for The WIYN Telescope Bench Spectrograph. I. Design, Construction, and Calibration
- The Palomar Transient Factory: System Overview, Performance and First Results
- The Dark Energy Survey: more than dark energy - an overview
- LSST Science Book, Version 2.0
- Improved Distances to Type Ia Supernovae with Multicolor Light Curve Shapes: MLCS2k2
- Luminous Supernovae
- The Supernova Legacy Survey 3-year sample: Type Ia Supernovae photometric distances and cosmological constraints
- Determining the Type, Redshift, and Age of a Supernova Spectrum
- Type Iax Supernovae: A New Class of Stellar Explosion
- Data Mining and Machine Learning in Astronomy
- Characterizing the V-band light-curves of hydrogen-rich type II supernovae
- The Carnegie Supernova Project: First Photometry Data Release of Low-Redshift Type Ia Supernovae
- Berkeley Supernova Ia Program I: Observations, Data Reduction, and Spectroscopic Sample of 582 Low-Redshift Type Ia Supernovae
- Cosmological Constraints from Measurements of Type Ia Supernovae discovered during the first 1.5 years of the Pan-STARRS1 Survey
- The Sloan Digital Sky Survey Monitor Telescope Pipeline
- Comparative Direct Analysis of Type Ia Supernova Spectra. II. Maximum Light
- The Carnegie Supernova Project: The Low-Redshift Survey
- The Spectroscopic Diversity of Type Ia Supernovae
- Type II Supernovae as Standardized Candles
- PHAT: PHoto-z Accuracy Testing
- The Sloan Digital Sky Survey-II Supernova Survey: Search Algorithm and Follow-up Observations
- The Superluminous Transient ASASSN-15lh as a Tidal Disruption Event from a Kerr Black Hole
- Master Robotic Net
- Towards Characterization of the Type IIP Supernova Progenitor Population: a Statistical Sample of Light Curves from Pan-STARRS1
- ASASSN-15lh: A Highly Super-Luminous Supernova
- Optical and Near-Infrared Observations of the Highly Reddened, Rapidly Expanding Type Ia Supernova 2006X in M100
- SuperNNova: an open-source framework for Bayesian, Neural Network based supernova classification
- A Study of the Type II-Plateau Supernova 1999gi, and the Distance to its Host Galaxy, NGC 3184
- Super-luminous supernovae at redshifts of 2.05 and 3.90
- Results from the Supernova Photometric Classification Challenge
- The Foundation Supernova Survey: Motivation, Design, Implementation, and First Data Release
- Spectroscopy of Type Ia Supernovae by the Carnegie Supernova Project
- Automated Transient Identification in the Dark Energy Survey
- The Asiago Supernova Catalogue- 10 years after
- Rapidly Decaying Supernova 2010X: A Candidate ".Ia" Explosion
- Finding Anomalous Periodic Time Series: An Application to Catalogs of Periodic Variable Stars
- Light curves of hydrogen-poor Superluminous Supernovae from the Palomar Transient Factory
- SN 2005bf: A Possible Transition Event Between Type Ib/c Supernovae and Gamma Ray Bursts
- Detection of Broad H Emission Lines in the Late-time Spectra of a Hydrogen-poor Superluminous Supernova
- An Unusually Fast-Evolving Supernova
- The weirdest SDSS galaxies: results from an outlier detection algorithm
- Searching for Exoplanets Using Artificial Intelligence
- The early detection and follow-up of the highly obscured Type II supernova 2016ija/DLT16am
- The SDSS-II Supernova Survey: Parameterizing the Type Ia Supernova Rate as a Function of Host Galaxy Properties
- Superluminous supernova 2015bn in the nebular phase: evidence for the engine-powered explosion of a stripped massive star
- Constraints on dark energy with the LOSS SN Ia sample
- The bright Type IIP SN 2009bw, showing signs of interaction
- Massive stars exploding in a He-rich circumstellar medium - IX. SN 2014av, and characterization of Type Ibn SNe
- 450 Days of Type II SN 2013ej in Optical and Near-Infrared
- A Search for New Candidate Super-Chandrasekhar-Mass Type Ia Supernovae in the Nearby Supernova Factory Dataset
- Asphericity, Interaction, and Dust in the Type II-P/II-L Supernova 2013ej in Messier 74
- Optimizing spectroscopic follow-up strategies for supernova photometric classification with active learning
- Machine learning for transient discovery in Pan-STARRS1 difference imaging
- Supernovae and their host galaxies. I. The SDSS DR8 database and statistics
- Direct evidence for a supernova interacting with a large amount of hydrogen-free circumstellar material
- Kernel PCA for type Ia supernovae photometric classification
- A Machine Learning Technique to Identify Transit Shaped Signals
- On the realistic validation of photometric redshifts, or why Teddy will never be Happy
- First-Year Spectroscopy for the SDSS-II Supernova Survey
- Early Observations of the Type Ia Supernova iPTF 16abc: A Case of Interaction with Nearby, Unbound Material and/or Strong Ejecta Mixing
- Photometric selection of Type Ia supernovae in the Supernova Legacy Survey
- SN 2013ab : A normal type IIP supernova in NGC 5669
- The Carnegie Supernova Project I: photometry data release of low-redshift stripped-envelope supernovae
- SN 2015U: A Rapidly Evolving and Luminous Type Ibn Supernova
- DASH: Deep Learning for the Automated Spectral Classification of Supernovae and their Hosts
- Machine Learning Classification of SDSS Transient Survey Images
- Supervised detection of anomalous light-curves in massive astronomical catalogs
- The ASAS-SN Bright Supernova Catalog -- IV. 2017
- Machine Learning based photometric redshifts for the KiDS ESO DR2 galaxies
- NTT and NOT spectroscopy of SDSS-II supernovae
- An Emerging Class of Bright, Fast-evolving Supernovae with Low-mass Ejecta
- Low-mass star formation triggered by early supernova explosions
- Unsupervised clustering of Type II supernova light curves
- STACCATO: A Novel Solution to Supernova Photometric Classification with Biased Training Sets
- Exploring the spectroscopic diversity of type Ia supernovae with DRACULA: a machine learning approach
- Star Formation Triggered by Supernova Explosions in Young Galaxies
- iPTF16abc and the population of Type Ia supernovae: Comparing the photospheric, transitional and nebular phases
- The Type Ia supernovae rate with Subaru/XMM-Newton Deep Survey
- Classification of Multiwavelength Transients with Machine Learning
- High Energy Cosmic Rays From Supernovae
Cited by in corpus (28)
- Fink, a new generation of broker for the LSST community
- Anomaly detection in the Zwicky Transient Facility DR3
- A Deep Learning Approach for Active Anomaly Detection of Extragalactic Transients
- Active Anomaly Detection for time-domain discoveries
- On Neural Architectures for Astronomical Time-series Classification with Application to Variable Stars
- ParSNIP: Generative Models of Transient Light Curves with Physics-Enabled Deep Learning
- Anomaly detection in Hyper Suprime-Cam galaxy images with generative adversarial networks
- Data mining techniques on astronomical spectra data. II : Classification Analysis
- The SNAD Viewer: Everything You Want to Know about Your Favorite ZTF Object
- Light curve classification with recurrent neural networks for GOTO: dealing with imbalanced data
- Real-Time Detection of Anomalies in Large-Scale Transient Surveys
- A method for finding anomalous astronomical light curves and their analogs
- Inferencing Progenitor and Explosion Properties of Evolving Core-collapse Supernovae from Zwicky Transient Facility Light Curves
- Preparing to discover the unknown with Rubin LSST -- I: Time domain
- Rapid sorting of radio galaxy morphology using Haralick features
- Pan-chromatic photometric classification of supernovae from multiple surveys and transfer learning for future surveys
- DECORAS: detection and characterization of radio-astronomical sources using deep learning
- Identifying outliers in astronomical images with unsupervised machine learning
- Identifying Light-curve Signals with a Deep Learning Based Object Detection Algorithm. II. A General Light Curve Classification Framework
- Searching for Anomalies in the ZTF Catalog of Periodic Variable Stars
- SNAD Transient Miner: Finding Missed Transient Events in ZTF DR4 using k-D trees
- Data-driven detection of multi-messenger transients
- A Classifier-Based Approach to Multi-Class Anomaly Detection for Astronomical Transients
- Finding radio transients with anomaly detection and active learning based on volunteer classifications
- A Template-Based Approach to the Photometric Classification of SN 1991bg-like Supernovae in the SDSS-II Supernova Survey
- Exploring the Universe with SNAD: Anomaly Detection in Astronomy
- Anomaly Detection for Multivariate Time Series of Exotic Supernovae
- PIE-ADA: Physics-Informed Ensemble with Adaptive Data Augmentation for Photometric Transient Classification