Computational Intelligence Challenges and Applications on Large-Scale Astronomical Time Series Databases

Abstract

Time-domain astronomy (TDA) is facing a paradigm shift caused by the exponential growth of the sample size, data complexity and data generation rates of new astronomical sky surveys. For example, the Large Synoptic Survey Telescope (LSST), which will begin operations in northern Chile in 2022, will generate a nearly 150 Petabyte imaging dataset of the southern hemisphere sky. The LSST will stream data at rates of 2 Terabytes per hour, effectively capturing an unprecedented movie of the sky. The LSST is expected not only to improve our understanding of time-varying astrophysical objects, but also to reveal a plethora of yet unknown faint and fast-varying phenomena. To cope with a change of paradigm to data-driven astronomy, the fields of astroinformatics and astrostatistics have been created recently. The new data-oriented paradigms for astronomy combine statistics, data mining, knowledge discovery, machine learning and computational intelligence, in order to provide the automated and robust methods needed for the rapid detection and classification of known astrophysical objects as well as the unsupervised characterization of novel phenomena. In this article we present an overview of machine learning and computational intelligence applications to TDA. Future big data challenges and new lines of research in TDA, focusing on the LSST, are identified and discussed from the viewpoint of computational intelligence/machine learning. Interdisciplinary collaboration will be required to cope with the challenges posed by the deluge of astronomical data coming from the LSST.

References in corpus (33)

• The Sloan Digital Sky Survey: Technical Summary
• Challenges of Big Data Analysis
• A Review of Feature Selection Methods Based on Mutual Information
• The MACHO Project: Microlensing Results from 5.7 Years of LMC Observations
• LSST Science Book, Version 2.0
• On Machine-Learned Classification of Variable Stars with Sparse and Noisy Time-Series Data
• Automated supervised classification of variable stars I. Methodology
• Random forest automated supervised classification of Hipparcos periodic variable stars
• Finding Anomalous Periodic Time Series: An Application to Catalogs of Periodic Variable Stars
• The Sloan Digital Sky Survey
• A comparison of period finding algorithms
• QSO Selection Algorithm Using Time Variability and Machine Learning: Selection of 1,620 QSO Candidates from MACHO LMC Database
• The Three-Point Correlation Function of Luminous Red Galaxies in the Sloan Digital Sky Survey
• Finding outlier light-curves in catalogs of periodic variable stars
• Variable stars across the observational HR diagram
• Using conditional entropy to identify periodicity
• Active Learning to Overcome Sample Selection Bias: Application to Photometric Variable Star Classification
• The automated classification of astronomical lightcurves using Kohonen self-organising maps
• Semi-supervised Learning for Photometric Supernova Classification
• Automatic Classification of Variable Stars in Catalogs with missing data
• An Information Theoretic Algorithm for Finding Periodicities in Stellar Light Curves
• Automated classification of periodic variable stars{Improved methodology for the automated classification of periodic variable stars}
• The EROS2 search for microlensing events towards the spiral arms: the complete seven season results
• Optical Gravitational Lensing Experiment. OGLE-2 -- the Second Phase of the OGLE Project
• Distances to Local Group Galaxies
• Astronomy in the Cloud: Using MapReduce for Image Coaddition
• Data challenges of time domain astronomy
• Feature Selection Strategies for Classifying High Dimensional Astronomical Data Sets
• Spectral Analysis of Stellar Light Curves by Means of Neural Networks
• Comparative clustering analysis of variable stars in the Hipparcos, OGLE Large Magellanic Cloud and CoRoT exoplanet databases
• Towards an Automated Classification of Transient Events in Synoptic Sky Surveys
• Some Pattern Recognition Challenges in Data-Intensive Astronomy
• Serendipity in Astronomy

Cited by in corpus (14)

• Gamma-ray and Optical Oscillations of 0716+714, MRK 421, and BL Lac
• Scalable End-to-end Recurrent Neural Network for Variable star classification
• A review of unsupervised learning in astronomy
• Robust period estimation using mutual information for multi-band light curves in the synoptic survey era
• Unsupervised Classification of Variable Stars
• Coconut: a scalable bottom-up approach for building data series indexes
• ATAT: Astronomical Transformer for time series And Tabular data
• Return of the Lernaean Hydra: Experimental Evaluation of Data Series Approximate Similarity Search
• Streaming Classification of Variable Stars
• The Lernaean Hydra of Data Series Similarity Search: An Experimental Evaluation of the State of the Art
• Enhanced Rotational Invariant Convolutional Neural Network for Supernovae Detection
• MSAD: A Deep Dive into Model Selection for Time series Anomaly Detection
• A Distributed Learning Architecture for Scientific Imaging Problems
• Coconut: sortable summarizations for scalable indexes over static and streaming data series