Using Machine Learning for Discovery in Synoptic Survey Imaging
arXiv:1209.3775 · doi:10.1093/mnras/stt1306
Abstract
Modern time-domain surveys continuously monitor large swaths of the sky to look for astronomical variability. Astrophysical discovery in such data sets is complicated by the fact that detections of real transient and variable sources are highly outnumbered by bogus detections caused by imperfect subtractions, atmospheric effects and detector artefacts. In this work we present a machine learning (ML) framework for discovery of variability in time-domain imaging surveys. Our ML methods provide probabilistic statements, in near real time, about the degree to which each newly observed source is astrophysically relevant source of variable brightness. We provide details about each of the analysis steps involved, including compilation of the training and testing sets, construction of descriptive image-based and contextual features, and optimization of the feature subset and model tuning parameters. Using a validation set of nearly 30,000 objects from the Palomar Transient Factory, we demonstrate a missed detection rate of at most 7.7% at our chosen false-positive rate of 1% for an optimized ML classifier of 23 features, selected to avoid feature correlation and over-fitting from an initial library of 42 attributes. Importantly, we show that our classification methodology is insensitive to mis-labelled training data up to a contamination of nearly 10%, making it easier to compile sufficient training sets for accurate performance in future surveys. This ML framework, if so adopted, should enable the maximization of scientific gain from future synoptic survey and enable fast follow-up decisions on the vast amounts of streaming data produced by such experiments.
16 pages, 14 figures
References in corpus (1)
Cited by in corpus (85)
- Confined Dense Circumstellar Material Surrounding a Regular Type II Supernova: The Unique Flash-Spectroscopy Event of SN 2013fs
- Design and operation of the ATLAS Transient Science Server
- iPTF16geu: A multiply imaged, gravitationally lensed type Ia supernova
- Flash Spectroscopy: Emission Lines from the Ionized Circumstellar Material around -Day-Old Type II Supernovae
- Host-Galaxy Properties of 32 Low-Redshift Superluminous Supernovae from the Palomar Transient Factory
- Strong Ultraviolet Pulse From a Newborn Type Ia Supernova
- Probabilistic Random Forest: A machine learning algorithm for noisy datasets
- Real-bogus classification for the Zwicky Transient Facility using deep learning
- Automated Transient Identification in the Dark Energy Survey
- Science with a wide-field UV transient explorer
- Machine Learning for the Zwicky Transient Facility
- Deep-HiTS: Rotation Invariant Convolutional Neural Network for Transient Detection
- K2 Variable Catalogue II: Machine Learning Classification of Variable Stars and Eclipsing Binaries in K2 Fields 0-4
- A Morphological Classification Model to Identify Unresolved PanSTARRS1 Sources: Application in the ZTF Real-Time Pipeline
- Machine Learning-based Brokers for Real-time Classification of the LSST Alert Stream
- The IPAC Image Subtraction and Discovery Pipeline for the intermediate Palomar Transient Factory
- Rapidly Rising Transients from Subaru Hyper Suprime-Cam Transient Survey
- Machine learning for transient discovery in Pan-STARRS1 difference imaging
- First Searches for Optical Counterparts to Gravitational-wave Candidate Events
- Ideas for Citizen Science in Astronomy
- Pan-STARRS and PESSTO search for an optical counterpart to the LIGO gravitational wave source GW150914
- The volumetric rate of normal type Ia supernovae in the local universe discovered by the Palomar Transient Factory
- Host Galaxies of Type Ic and Broad-lined Type Ic Supernovae from the Palomar Transient Factory: Implication for Jet Production
- The Needle in the 100 deg2 Haystack: Uncovering Afterglows of Fermi GRBs with the Palomar Transient Factory
- iPTF Search for an Optical Counterpart to Gravitational Wave Trigger GW150914
- Intermediate Palomar Transient Factory: Realtime Image Subtraction Pipeline
- Machine Learning Classification of SDSS Transient Survey Images
- A transient search using combined human and machine classifications
- Deep Learning for Image Sequence Classification of Astronomical Events
- Automated Classification of Periodic Variable Stars detected by the Wide-field Infrared Survey Explorer
- Characterizing the local relation between star formation rate and gas-phase metallicity in MaNGA spiral galaxies
- Convolutional Neural Networks for Transient Candidate Vetting in Large-Scale Surveys
- Kiso Supernova Survey (KISS): Survey Strategy
- A Machine Learning Method to Infer Fundamental Stellar Parameters from Photometric Light Curves
- Transient-optimised real-bogus classification with Bayesian Convolutional Neural Networks -- sifting the GOTO candidate stream
- Small near-Earth asteroids in the Palomar Transient Factory survey: A real-time streak-detection system
- SNIa-Cosmology Analysis Results from Simulated LSST Images: from Difference Imaging to Constraints on Dark Energy
- Automatic vetting of planet candidates from ground based surveys: Machine learning with NGTS
- Machine Learning for Observational Cosmology
- Machine-learning Selection of Optical Transients in Subaru/Hyper Suprime-Cam Survey
- Light curve classification with recurrent neural networks for GOTO: dealing with imbalanced data
- Color Me Intrigued: the Discovery of iPTF 16fnm, a Supernova 2002cx-like Object
- J-GEM Follow-Up Observations to Search for an Optical Counterpart of The First Gravitational Wave Source GW150914
- Multivariate Classification with Random Forests for Gravitational Wave Searches of Black Hole Binary Coalescence
- iPTF Archival Search for Fast Optical Transients
- A Machine Learning Classifier for Microlensing in Wide-Field Surveys
- Optical Transient Object Classification in Wide Field Small Aperture Telescopes with Neural Networks
- Identifying Tidal Disruption Events via Prior Photometric Selection of Their Preferred Hosts
- Machine Learning Based Real Bogus System for HSC-SSP Moving Object Detecting Pipeline
- Finding Black Holes with Black Boxes -- Using Machine Learning to Identify Globular Clusters with Black Hole Subsystems
- Beyond the Local Volume. I. Surface Densities of Ultracool Dwarfs in Deep HST/WFC3 Parallel Fields
- Preparing for advanced LIGO: A Star-Galaxy Separation Catalog for the Palomar Transient Factory
- Statistical Searches for Microlensing Events in Large, Non-Uniformly Sampled Time-Domain Surveys: A Test Using Palomar Transient Factory Data
- Machine Learning for Transient Recognition in Difference Imaging With Minimum Sampling Effort
- Flares hunting in hot subdwarf and white dwarf stars from Cycles 1-5 of TESS photometry
- Single-epoch supernova classification with deep convolutional neural networks
- The HST See Change Program: I. Survey Design, Pipeline, and Supernova Discoveries
- A classification algorithm for time-domain novelties in preparation for LSST alerts: Application to variable stars and transients detected with DECam in the Galactic Bulge
- The Palomar Transient Factory Sky2Night programme
- GS-TEC: the Gaia Spectrophotometry Transient Events Classifier
- Detection of Strongly Lensed Arcs in Galaxy Clusters with Transformers
- Membership analysis and 3D kinematics of the star-forming complex around Trumpler 37 using Gaia-DR3
- iPTF Survey for Cool Transients
- Semi-Supervised Classification and Clustering Analysis for Variable Stars
- The Synthetic-Oversampling Method: Using Photometric Colors to Discover Extremely Metal-Poor Stars
- The Evryscope Fast Transient Engine: Real-Time Detection for Rapidly Evolving Transients
- Merged or monolithic? Using machine-learning to reconstruct the dynamical history of simulated star clusters
- Ask The Machine: Systematic detection of wind-type outflows in low-mass X-ray binaries
- Deep-learning Real/Bogus classification for the Tomo-e Gozen transient survey
- The classification of real and bogus transients using active learning and semi-supervised learning
- Forecasting Supernova Observations with the CSST: I. Photometric Samples
- Automated Transient Detection with Shapelet Analysis in Image-subtracted Data
- Life Beyond PTF
- Online classification for time-domain astronomy
- YOUNG Star detrending for Transiting Exoplanet Recovery (YOUNGSTER) II: Using Self-Organising Maps to explore young star variability in Sectors 1-13 of TESS data
- Towards Rate Estimation for Transient Surveys I: Assessing Transient Detectability and Volume Sensitivity for iPTF
- A Morphological Classification Model to Identify Unresolved PanSTARRS1 Sources II: Update to the PS1 Point Source Catalog
- Multi-scale stamps for real-time classification of alert streams
- The Gravitational-wave Optical Transient Observer (GOTO): prototype performance and prospects for transient science
- The automation of optical transient discovery and classification in Rubin-era time-domain astronomy
- Dark from light (DfL): Inferring halo properties from luminous tracers with machine learning trained on cosmological simulations. I. Method, proof of concept & preliminary testing
- Real-bogus scores for active anomaly detection
- Exploring the Vision Processing Unit as Co-processor for Inference
- Identifying transient and variable sources in radio images
- Phenomenological classification of the Zwicky Transient Facility astronomical event alerts