A recurrent neural network for classification of unevenly sampled variable stars

Abstract

Astronomical surveys of celestial sources produce streams of noisy time series measuring flux versus time ("light curves"). Unlike in many other physical domains, however, large (and source-specific) temporal gaps in data arise naturally due to intranight cadence choices as well as diurnal and seasonal constraints. With nightly observations of millions of variable stars and transients from upcoming surveys, efficient and accurate discovery and classification techniques on noisy, irregularly sampled data must be employed with minimal human-in-the-loop involvement. Machine learning for inference tasks on such data traditionally requires the laborious hand-coding of domain-specific numerical summaries of raw data ("features"). Here we present a novel unsupervised autoencoding recurrent neural network (RNN) that makes explicit use of sampling times and known heteroskedastic noise properties. When trained on optical variable star catalogs, this network produces supervised classification models that rival other best-in-class approaches. We find that autoencoded features learned on one time-domain survey perform nearly as well when applied to another survey. These networks can continue to learn from new unlabeled observations and may be used in other unsupervised tasks such as forecasting and anomaly detection.

arXiv comment23 pages, 14 figures. The published version is at Nature Astronomy (https://www.nature.com/articles/s41550-017-0321-z). Source code for models, experiments, and figures at https://github.com/bnaul/IrregularTimeSeriesAutoencoderPaper (Zenodo Code DOI: 10.5281/zenodo.1045560)

References in corpus (13)

• First Results from the All-Sky Monitor on the Rossi X-ray Timing Explorer
• On Machine-Learned Classification of Variable Stars with Sparse and Noisy Time-Series Data
• Random forest automated supervised classification of Hipparcos periodic variable stars
• Exploring the Variable Sky with LINEAR. III. Classification of Periodic Light Curves
• VAST: An ASKAP Survey for Variables and Slow Transients
• Exploring the Variable Sky with LINEAR. II. Halo Structure and Substructure Traced by RR Lyrae Stars to 30 kpc
• Construction of a Calibrated Probabilistic Classification Catalog: Application to 50k Variable Sources in the All-Sky Automated Survey
• A Package for the Automated Classification of Periodic Variable Stars
• Supervised detection of anomalous light-curves in massive astronomical catalogs
• A Machine Learning Method to Infer Fundamental Stellar Parameters from Photometric Light Curves
• Clustering Based Feature Learning on Variable Stars
• The Variable Sky of Deep Synoptic Surveys
• Real-Time Data Mining of Massive Data Streams from Synoptic Sky Surveys

Cited by in corpus (71)

• The Zwicky Transient Facility: Science Objectives
• The Automatic Learning for the Rapid Classification of Events (ALeRCE) Alert Broker
• Probabilistic Random Forest: A machine learning algorithm for noisy datasets
• RAPID: Early Classification of Explosive Transients using Deep Learning
• Machine Learning for the Zwicky Transient Facility
• Alert Classification for the ALeRCE Broker System: The Light Curve Classifier
• Surveying the reach and maturity of machine learning and artificial intelligence in astronomy
• SuperRAENN: A Semi-supervised Supernova Photometric Classification Pipeline Trained on Pan-STARRS1 Medium Deep Survey Supernovae
• Dimensionality Reduction of SDSS Spectra with Variational Autoencoders
• Optimizing spectroscopic follow-up strategies for supernova photometric classification with active learning
• Astronomia ex machina: a history, primer, and outlook on neural networks in astronomy
• Machine-learning Approaches to Exoplanet Transit Detection and Candidate Validation in Wide-field Ground-based Surveys
• Data-Driven Reconstruction of Gravitationally Lensed Galaxies using Recurrent Inference Machines
• Alert Classification for the ALeRCE Broker System: The Real-time Stamp Classifier
• Machine Learning Techniques for Stellar Light Curve Classification
• Scalable End-to-end Recurrent Neural Network for Variable star classification
• Double-, triple-line spectroscopic candidates in the LAMOST Medium-Resolution Spectroscopic Survey
• Searching for changing-state AGNs in massive datasets -- I: applying deep learning and anomaly detection techniques to find AGNs with anomalous variability behaviours
• Deep multi-survey classification of variable stars
• Deep Learning for Image Sequence Classification of Astronomical Events
• On Neural Architectures for Astronomical Time-series Classification with Application to Variable Stars
• Deep modeling of quasar variability
• ASTROMER: A transformer-based embedding for the representation of light curves
• ParSNIP: Generative Models of Transient Light Curves with Physics-Enabled Deep Learning
• The ZTF Source Classification Project: I. Methods and Infrastructure
• Real-Time Likelihood-Free Inference of Roman Binary Microlensing Events with Amortized Neural Posterior Estimation
• Applications of Machine Learning to Predicting Core-collapse Supernova Explosion Outcomes
• Phase Detection with Neural Networks: Interpreting the Black Box
• Deep Neural Network Classifier for Variable Stars with Novelty Detection Capability
• Deep Attention-Based Supernovae Classification of Multi-Band Light-Curves
• Real-Time Detection of Anomalies in Large-Scale Transient Surveys
• Stellar population of the Rosette Nebula and NGC 2244: application of the probabilistic random forest
• A machine-learning photometric classifier for massive stars in nearby galaxies I. The method
• Photometric Classification of Early-Time Supernova Lightcurves with SCONE
• Classification of Fermi-LAT sources with deep learning using energy and time spectra
• Searching for AGN and Pulsar Candidates in 4FGL Unassociated Sources Using Machine Learning
• Classification of Periodic Variable Stars with Novel Cyclic-Permutation Invariant Neural Networks
• LSST Cadence Strategy Evaluations for AGN Time-series Data in Wide-Fast-Deep Field
• ATAT: Astronomical Transformer for time series And Tabular data
• Classification of Multiwavelength Transients with Machine Learning
• Clumpiness: Time-domain classification of red-giant evolutionary states
• The effect of phased recurrent units in the classification of multiple catalogs of astronomical lightcurves
• Identifying Light-curve Signals with a Deep Learning Based Object Detection Algorithm. II. A General Light Curve Classification Framework
• Searching for Anomalies in the ZTF Catalog of Periodic Variable Stars
• Calibrating Long Period Variables as Standard Candles with Machine Learning
• Near-Infrared Search for Fundamental-mode RR Lyrae Stars Toward the Inner Bulge by Deep Learning
• Periodic Variable Star Classification with Deep Learning: Handling Data Imbalance in an Ensemble Augmentation Way
• Understanding of the properties of neural network approaches for transient light curve approximations
• Semi-Supervised Classification and Clustering Analysis for Variable Stars
• A Detection Metric Designed for O'Connell Effect Eclipsing Binaries
• Variable Star Classification Using Multi-View Metric Learning
• Representation Learning for Time-Domain High-Energy Astrophysics: Discovery of Extragalactic Fast X-ray Transient XRT 200515
• Application of Convolutional Neural Networks to time domain astrophysics. 2D image analysis of OGLE light curves
• Leveraging Deep Learning for Time Series Extrinsic Regression in predicting photometric metallicity of Fundamental-mode RR Lyrae Stars
• YOUNG Star detrending for Transiting Exoplanet Recovery (YOUNGSTER) II: Using Self-Organising Maps to explore young star variability in Sectors 1-13 of TESS data
• Machine learning based stellar classification with highly sparse photometry data
• Informative Bayesian model selection for RR Lyrae star classifiers
• An Information Theory Approach on Deciding Spectroscopic Follow Ups
• MAGIC: Microlensing Analysis Guided by Intelligent Computation
• Real-time Light Curve Classification Framework for the Wide Field Survey Telescope Using Modified Semi-supervised Variational Auto-Encoder
• Learning novel representations of variable sources from multi-modal $\text{Gaia}$ data via autoencoders
• Leveraging pre-trained vision Transformers for multi-band photometric light curve classification
• Uncertainty estimation for time series classification: Exploring predictive uncertainty in transformer-based models for variable stars
• Pushing the Technical Frontier: From Overwhelmingly Large Data Sets to Machine Learning
• Multivariate time series transformer embeddings for light curves of periodic variable stars
• Informative regularization for a multi-layer perceptron RR Lyrae classifier under data shift
• Heartbeat Stars Recognition Based on Recurrent Neural Networks: Method and Validation
• Construction of a far ultraviolet all sky map from an incomplete survey: Application of a deep learning algorithm
• Light curve fingerprints: an automated approach to the extraction of X-ray variability patterns with feature aggregation -- an example application to GRS 1915+105
• Pushing the Limit of Asteroseismic Detection for Cool Dwarfs using TESS and Deep Learning
• Modeling Irregular Astronomical Time Series with Neural Stochastic Delay Differential Equations