Scalable End-to-end Recurrent Neural Network for Variable star classification

Abstract

During the last decade, considerable effort has been made to perform automatic classification of variable stars using machine learning techniques. Traditionally, light curves are represented as a vector of descriptors or features used as input for many algorithms. Some features are computationally expensive, cannot be updated quickly and hence for large datasets such as the LSST cannot be applied. Previous work has been done to develop alternative unsupervised feature extraction algorithms for light curves, but the cost of doing so still remains high. In this work, we propose an end-to-end algorithm that automatically learns the representation of light curves that allows an accurate automatic classification. We study a series of deep learning architectures based on Recurrent Neural Networks and test them in automated classification scenarios. Our method uses minimal data preprocessing, can be updated with a low computational cost for new observations and light curves, and can scale up to massive datasets. We transform each light curve into an input matrix representation whose elements are the differences in time and magnitude, and the outputs are classification probabilities. We test our method in three surveys: OGLE-III, Gaia and WISE. We obtain accuracies of about $95\%$ in the main classes and $75\%$ in the majority of subclasses. We compare our results with the Random Forest classifier and obtain competitive accuracies while being faster and scalable. The analysis shows that the computational complexity of our approach grows up linearly with the light curve size, while the traditional approach cost grows as $N\log (N)$.

15 pages, 17 figures. To be published in MNRAS

References in corpus (39)

• Adam: A Method for Stochastic Optimization
• Scikit-learn: Machine Learning in Python
• Neural Machine Translation by Jointly Learning to Align and Translate
• TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
• Gaia Data Release 2. Summary of the contents and survey properties
• The Wide-field Infrared Survey Explorer (WISE): Mission Description and Initial On-orbit Performance
• The Gaia mission
• A Critical Review of Recurrent Neural Networks for Sequence Learning
• Understanding the Lomb-Scargle Periodogram
• LSST Science Book, Version 2.0
• Rotation-invariant convolutional neural networks for galaxy morphology prediction
• Identifying Exoplanets with Deep Learning: A Five Planet Resonant Chain around Kepler-80 and an Eighth Planet around Kepler-90
• On Machine-Learned Classification of Variable Stars with Sparse and Noisy Time-Series Data
• Automated supervised classification of variable stars I. Methodology
• Random forest automated supervised classification of Hipparcos periodic variable stars
• The MACHO Project First Year LMC Results: The Microlensing Rate and the Nature of the Galactic Dark Halo
• Gaia Data Release 2. Cross-match with external catalogues - Algorithms and results
• Gaia Data Release 2: Variable stars in the colour-absolute magnitude diagram
• A recurrent neural network for classification of unevenly sampled variable stars
• Deep-HiTS: Rotation Invariant Convolutional Neural Network for Transient Detection
• Deep Recurrent Neural Networks for Supernovae Classification
• QSO Selection Algorithm Using Time Variability and Machine Learning: Selection of 1,620 QSO Candidates from MACHO LMC Database
• The EPOCH Project: I. Periodic variable stars in the EROS-2 LMC database
• Computational Intelligence Challenges and Applications on Large-Scale Astronomical Time Series Databases
• A Package for the Automated Classification of Periodic Variable Stars
• Mapping the outer bulge with RRab stars from the VVV Survey
• Deep multi-survey classification of variable stars
• A machine learned classifier for RR Lyrae in the VVV survey
• Convolutional Neural Networks for Transient Candidate Vetting in Large-Scale Surveys
• Automatic Classification of Variable Stars in Catalogs with missing data
• An improved quasar detection method in EROS-2 and MACHO LMC datasets
• Clustering Based Feature Learning on Variable Stars
• Unsupervised Classification of Variable Stars
• FATS: Feature Analysis for Time Series
• Meta Classification for Variable Stars
• Automatic Survey-Invariant Variable Star Classification
• Astrophysics and Big Data: Challenges, Methods, and Tools
• Optimizing Automated Classification of Periodic Variable Stars in New Synoptic Surveys
• Everything we'd like to do with LSST data, but we don't know (yet) how

Cited by in corpus (31)

• Alert Classification for the ALeRCE Broker System: The Light Curve Classifier
• Alert Classification for the ALeRCE Broker System: The Real-time Stamp Classifier
• Deep modeling of quasar variability
• ASTROMER: A transformer-based embedding for the representation of light curves
• Light curve classification with recurrent neural networks for GOTO: dealing with imbalanced data
• Deep Attention-Based Supernovae Classification of Multi-Band Light-Curves
• Image-based Classification of Variable Stars: First Results from Optical Gravitational Lensing Experiment Data
• Classification of Fermi-LAT sources with deep learning using energy and time spectra
• Persistent and occasional: searching for the variable population of the ZTF/4MOST sky using ZTF data release 11
• Classification of OGLE eclipsing binary stars based on their morphology type with Locally Linear Embedding
• LSST Cadence Strategy Evaluations for AGN Time-series Data in Wide-Fast-Deep Field
• Classification of Periodic Variable Stars with Novel Cyclic-Permutation Invariant Neural Networks
• ATAT: Astronomical Transformer for time series And Tabular data
• DECORAS: detection and characterization of radio-astronomical sources using deep learning
• The effect of phased recurrent units in the classification of multiple catalogs of astronomical lightcurves
• Identifying Light-curve Signals with a Deep Learning Based Object Detection Algorithm. II. A General Light Curve Classification Framework
• Understanding of the properties of neural network approaches for transient light curve approximations
• Semi-Supervised Classification and Clustering Analysis for Variable Stars
• 3D Detection and Characterisation of ALMA Sources through Deep Learning
• Application of Convolutional Neural Networks to time domain astrophysics. 2D image analysis of OGLE light curves
• Informative Bayesian model selection for RR Lyrae star classifiers
• Real-time Light Curve Classification Framework for the Wide Field Survey Telescope Using Modified Semi-supervised Variational Auto-Encoder
• Leveraging pre-trained vision Transformers for multi-band photometric light curve classification
• Uncertainty estimation for time series classification: Exploring predictive uncertainty in transformer-based models for variable stars
• Multivariate time series transformer embeddings for light curves of periodic variable stars
• Sparse logistic regression for RR Lyrae vs binaries classification
• Heartbeat Stars Recognition Based on Recurrent Neural Networks: Method and Validation
• Informative regularization for a multi-layer perceptron RR Lyrae classifier under data shift
• Pushing the Limit of Asteroseismic Detection for Cool Dwarfs using TESS and Deep Learning
• Light curve fingerprints: an automated approach to the extraction of X-ray variability patterns with feature aggregation -- an example application to GRS 1915+105
• The Variable Sky Through the OGLE Eye