Automated Transient Identification in the Dark Energy Survey
arXiv:1504.02936 · doi:10.1088/0004-6256/150/3/82
Abstract
We describe an algorithm for identifying point-source transients and moving objects on reference-subtracted optical images containing artifacts of processing and instrumentation. The algorithm makes use of the supervised machine learning technique known as Random Forest. We present results from its use in the Dark Energy Survey Supernova program (DES-SN), where it was trained using a sample of 898,963 signal and background events generated by the transient detection pipeline. After reprocessing the data collected during the first DES-SN observing season (Sep. 2013 through Feb. 2014) using the algorithm, the number of transient candidates eligible for human scanning decreased by a factor of 13.4, while only 1 percent of the artificial Type Ia supernovae (SNe) injected into search images to monitor survey efficiency were lost, most of which were very faint events. Here we characterize the algorithm's performance in detail, and we discuss how it can inform pipeline design decisions for future time-domain imaging surveys, such as the Large Synoptic Survey Telescope and the Zwicky Transient Facility. An implementation of the algorithm and the training data used in this paper are available at http://portal.nersc.gov/project/dessn/autoscan.
arXiv comment24 pages, 9 figures, 4 tables v3: added link to training data / implementation
References in corpus (30)
- The Supernova Legacy Survey: Measurement of Omega_M, Omega_Lambda and w from the First Year Data Set
- Cosmic-Ray Rejection by Laplacian Edge Detection
- The High-Z Supernova Search: Measuring Cosmic Deceleration and Global Cur vature of the Universe Using Type Ia Supernovae
- A method for optimal image subtraction
- LSST Science Book, Version 2.0
- Preliminary Results from NEOWISE: An Enhancement to the Wide-field Infrared Survey Explorer for Solar System Science
- Observed Fractions of Core-Collapse Supernova Types and Initial Masses of their Single and Binary Progenitor Stars
- The Sloan Digital Sky Survey-II Supernova Survey: Technical Summary
- Report of the Dark Energy Task Force
- Cosmological Constraints from Measurements of Type Ia Supernovae discovered during the first 1.5 years of the Pan-STARRS1 Survey
- SNANA: A Public Software Package for Supernova Analysis
- On Machine-Learned Classification of Variable Stars with Sparse and Noisy Time-Series Data
- The Hubble Higher-Z Supernova Search: Supernovae to z=1.6 and Constraints on Type Ia Progenitor Models
- The Blanco Cosmology Survey: Data Acquisition, Processing, Calibration, Quality Diagnostics and Data Release
- The Sloan Digital Sky Survey-II Supernova Survey: Search Algorithm and Follow-up Observations
- The Data Release of the Sloan Digital Sky Survey-II Supernova Survey
- Galaxy Zoo: Reproducing Galaxy Morphologies Via Machine Learning
- Supernova Simulations and Strategies For the Dark Energy Survey
- Automating Discovery and Classification of Transients and Variable Stars in the Synoptic Survey Era
- Photometric SN Ia Candidates from the Three-Year SDSS-II SN Survey Data
- Using Machine Learning for Discovery in Synoptic Survey Imaging
- Dynamical Analysis of Nearby ClustErs. Automated astrometry from the ground: precision proper motions over wide field
- Type Ia supernova rate at a redshift of ~ 0.1
- Machine learning for transient discovery in Pan-STARRS1 difference imaging
- How to Find More Supernovae with Less Work: Object Classification Techniques for Difference Imaging
- Active Learning to Overcome Sample Selection Bias: Application to Photometric Variable Star Classification
- A simple and robust method for automated photometric classification of supernovae using neural networks
- Machine Learning Classification of SDSS Transient Survey Images
- The QUEST Large Area CCD Camera
- Main-belt comets in the Palomar Transient Factory survey: I. The search for extendedness
Cited by in corpus (106)
- Dark Energy Survey Year 3 Results: Cosmological Constraints from Galaxy Clustering and Weak Lensing
- The Dark Energy Survey: more than dark energy - an overview
- The Electromagnetic Counterpart of the Binary Neutron Star Merger LIGO/Virgo GW170817. I. Dark Energy Camera Discovery of the Optical Counterpart
- Design and operation of the ATLAS Transient Science Server
- First Cosmology Results using Type Ia Supernovae from the Dark Energy Survey: Constraints on Cosmological Parameters
- The Dark Energy Survey Image Processing Pipeline
- Galaxy Interactions Trigger Rapid Black Hole Growth: an unprecedented view from the Hyper Suprime-Cam Survey
- The Difference Imaging Pipeline for the Transient Search in the Dark Energy Survey
- Real-bogus classification for the Zwicky Transient Facility using deep learning
- Rapidly evolving transients in the Dark Energy Survey
- Machine Learning for the Zwicky Transient Facility
- First Cosmology Results Using Type Ia Supernovae From the Dark Energy Survey: Analysis, Systematic Uncertainties, and Validation
- The weirdest SDSS galaxies: results from an outlier detection algorithm
- Deep-HiTS: Rotation Invariant Convolutional Neural Network for Transient Detection
- GROWTH on S190814bv: Deep Synoptic Limits on the Optical/Near-Infrared Counterpart to a Neutron Star-Black Hole Merger
- Cosmological Constraints from Multiple Probes in the Dark Energy Survey
- A Morphological Classification Model to Identify Unresolved PanSTARRS1 Sources: Application in the ZTF Real-Time Pipeline
- Superluminous Supernovae from the Dark Energy Survey
- Host Galaxy Identification for Supernova Surveys
- First Cosmology Results using Type Ia Supernovae from the Dark Energy Survey: The Effect of Host Galaxy Properties on Supernova Luminosity
- DES14X3taz: A Type I Superluminous Supernova Showing a Luminous, Rapidly Cooling Initial Pre-Peak Bump
- Machine Learning-based Brokers for Real-time Classification of the LSST Alert Stream
- The IPAC Image Subtraction and Discovery Pipeline for the intermediate Palomar Transient Factory
- First Cosmology Results using Type Ia Supernova from the Dark Energy Survey: Simulations to Correct Supernova Distance Biases
- First Cosmology Results Using Type Ia Supernovae From the Dark Energy Survey: Photometric Pipeline and Light Curve Data Release
- Quasar Accretion Disk Sizes From Continuum Reverberation Mapping From the Dark Energy Survey
- A Deep Learning Approach to Galaxy Cluster X-ray Masses
- The LSST DESC DC2 Simulated Sky Survey
- Rates and Properties of Strongly Gravitationally Lensed Supernovae and their Host Galaxies in Time-Domain Imaging Surveys
- The Large Synoptic Survey Telescope as a Near-Earth Object Discovery Machine
- A Dark Energy Camera Search for an Optical Counterpart to the First Advanced LIGO Gravitational Wave Event GW150914
- Pan-STARRS and PESSTO search for an optical counterpart to the LIGO gravitational wave source GW150914
- Alert Classification for the ALeRCE Broker System: The Real-time Stamp Classifier
- Machine Learning Classification of SDSS Transient Survey Images
- Rates and delay times of type Ia supernovae in the Dark Energy Survey
- Discovery and Dynamical Analysis of an Extreme Trans-Neptunian Object with a High Orbital Inclination
- First Cosmology Results Using Type Ia Supernovae From the Dark Energy Survey: Survey Overview and Supernova Spectroscopy
- A transient search using combined human and machine classifications
- YSE-PZ: A Transient Survey Management Platform that Empowers the Human-in-the-Loop
- GROWTH on S190426c. II. Real-Time Search for a Counterpart to the Probable Neutron Star-Black Hole Merger using an Automated Difference Imaging Pipeline for DECam
- The High Cadence Transient Survey (HiTS) - I. Survey design and supernova shock breakout constraints
- An analysis of feature relevance in the classification of astronomical transients with machine learning methods
- Characterizing the local relation between star formation rate and gas-phase metallicity in MaNGA spiral galaxies
- A Search for Kilonovae in the Dark Energy Survey
- Constraints on the Physical Properties of GW190814 through Simulations based on DECam Follow-up Observations by the Dark Energy Survey
- Convolutional Neural Networks for Transient Candidate Vetting in Large-Scale Surveys
- Anomaly Detection in the Open Supernova Catalog
- The Dark Energy Survey Supernova Program: Modelling selection efficiency and observed core collapse supernova contamination
- Studying the Ultraviolet Spectrum of the First Spectroscopically Confirmed Supernova at redshift two
- The Host Galaxies of Rapidly Evolving Transients in the Dark Energy Survey
- Transient-optimised real-bogus classification with Bayesian Convolutional Neural Networks -- sifting the GOTO candidate stream
- Trans-Neptunian objects found in the first four years of the Dark Energy Survey
- GROWTH on S190510g: DECam Observation Planning and Follow-Up of a Distant Binary Neutron Star Merger Candidate
- The Dark Energy Survey 5-year photometrically identified Type Ia Supernovae
- Discovery of a Candidate Binary Supermassive Black Hole in a Periodic Quasar from Circumbinary Accretion Variability
- SNIa-Cosmology Analysis Results from Simulated LSST Images: from Difference Imaging to Constraints on Dark Energy
- Discovery and Physical Characterization of a Large Scattered Disk Object at 92 AU
- Measuring Cosmological Parameters with Type Ia Supernovae in redMaGiC galaxies
- DES Y1 results: Splitting growth and geometry to test CDM
- Machine-learning Selection of Optical Transients in Subaru/Hyper Suprime-Cam Survey
- Euclid: Superluminous supernovae in the Deep Survey
- Modeling the Performance of the LSST in Surveying the Near-Earth Object Population
- Asteroid Discovery and Characterization with the Large Synoptic Survey Telescope (LSST)
- Supernova Siblings: Assessing the Consistency of Properties of Type Ia Supernovae that Share the Same Parent Galaxies
- An Infrared Search for Kilonovae with the WINTER Telescope. I. Binary Neutron Star Mergers
- Observation of Two New L4 Neptune Trojans in the Dark Energy Survey Supernova Fields
- Vetting the optical transient candidates detected by the GWAC network using convolutional neural networks
- Spectroscopic Studies of Type Ia Supernovae Using LSTM Neural Networks
- Optical Transient Object Classification in Wide Field Small Aperture Telescopes with Neural Networks
- Searching for Planet Nine with Coadded WISE and NEOWISE-Reactivation Images
- Machine Learning Based Real Bogus System for HSC-SSP Moving Object Detecting Pipeline
- A Search for Optical Emission from Binary-Black-Hole Merger GW170814 with the Dark Energy Camera
- Machine-z: Rapid Machine Learned Redshift Indicator for Swift Gamma-ray Bursts
- Sky Subtraction in an Era of Low Surface Brightness Astronomy
- The HST See Change Program: I. Survey Design, Pipeline, and Supernova Discoveries
- deepSIP: Linking Type Ia Supernova Spectra to Photometric Quantities with Deep Learning
- A classification algorithm for time-domain novelties in preparation for LSST alerts: Application to variable stars and transients detected with DECam in the Galactic Bulge
- Optical follow-up of gravitational wave triggers with DECam during the first two LIGO/VIRGO observing runs
- What's the Difference? The potential for Convolutional Neural Networks for transient detection without template subtraction
- Dynamical Analysis of Three Distant Trans-Neptunian Objects with Similar Orbits
- A DECam Search for Explosive Optical Transients Associated with IceCube Neutrinos
- Radio Afterglows from Compact Binary Coalescences: Prospects for Next-Generation Telescopes
- DES16C3cje: A low-luminosity, long-lived supernova
- Deep Drilling in the Time Domain with DECam: Survey Characterization
- Photometric classification of HSC transients using machine learning
- Gaia eclipsing binary and multiple systems. Supervised classification and self-organizing maps
- Core-collapse Supernovae in the Dark Energy Survey: Luminosity Functions and Host Galaxy Demographics
- Machine Learning based search for Cataclysmic Variables within Gaia Science Alerts
- The Evryscope Fast Transient Engine: Real-Time Detection for Rapidly Evolving Transients
- Identifying Transients in the Dark Energy Survey using Convolutional Neural Networks
- The classification of real and bogus transients using active learning and semi-supervised learning
- Automated Transient Detection with Shapelet Analysis in Image-subtracted Data
- Expediting DECam Multimessenger Counterpart Searches with Convolutional Neural Networks
- Multi-scale stamps for real-time classification of alert streams
- A Morphological Classification Model to Identify Unresolved PanSTARRS1 Sources II: Update to the PS1 Point Source Catalog
- Image plane detection of FRB121102 with the MeerKAT radio telescope
- Real-bogus scores for active anomaly detection
- The automation of optical transient discovery and classification in Rubin-era time-domain astronomy
- Learn from every mistake! Hierarchical information combination in astronomy
- Evidence for Color Dichotomy in the Primordial Neptunian Trojan Population
- A DESGW Search for the Electromagnetic Counterpart to the LIGO/Virgo Gravitational Wave Binary Neutron Star Merger Candidate S190510g
- Sifting the debris: Patterns in the SNR population with unsupervised ML methods
- SOAR/Goodman Spectroscopic Assessment of Candidate Counterparts of the LIGO-Virgo Event GW190814
- Investigating the Effects of Point Source Injection Strategies on KMTNet Real/Bogus Classification
- Deep Learning generated observations of galaxy clusters from dark-matter-only simulations
- Phenomenological classification of the Zwicky Transient Facility astronomical event alerts