Data mining techniques on astronomical spectra data. II : Classification Analysis

Abstract

Classification is valuable and necessary in spectral analysis, especially for data-driven mining. Along with the rapid development of spectral surveys, a variety of classification techniques have been successfully applied to astronomical data processing. However, it is difficult to select an appropriate classification method in practical scenarios due to the different algorithmic ideas and data characteristics. Here, we present the second work in the data mining series - a review of spectral classification techniques. This work also consists of three parts: a systematic overview of current literature, experimental analyses of commonly used classification algorithms and source codes used in this paper. Firstly, we carefully investigate the current classification methods in astronomical literature and organize these methods into ten types based on their algorithmic ideas. For each type of algorithm, the analysis is organized from the following three perspectives. (1) their current applications and usage frequencies in spectral classification are summarized; (2) their basic ideas are introduced and preliminarily analysed; (3) the advantages and caveats of each type of algorithm are discussed. Secondly, the classification performance of different algorithms on the unified data sets is analysed. Experimental data are selected from the LAMOST survey and SDSS survey. Six groups of spectral data sets are designed from data characteristics, data qualities and data volumes to examine the performance of these algorithms. Then the scores of nine basic algorithms are shown and discussed in the experimental analysis. Finally, nine basic algorithms source codes written in python and manuals for usage and improvement are provided.

arXiv comment25 pages, 41 figures

References in corpus (79)

• XGBoost: A Scalable Tree Boosting System
• Array Programming with NumPy
• The First Data Release (DR1) of the LAMOST general survey
• Spectral Classification and Redshift Measurement for the SDSS-III Baryon Oscillation Spectroscopic Survey
• The Data Analysis Pipeline for the SDSS-IV MaNGA IFU Galaxy Survey: Overview
• Comparison of decision tree methods for finding active objects
• The Data Release of the Sloan Digital Sky Survey-II Supernova Survey
• The SDSS Imaging Pipelines
• An empirical template library of stellar spectra for a wide range of spectral classes, luminosity classes, and metallicities using SDSS BOSS spectra
• Decision Tree Classifiers for Star/Galaxy Separation
• Automatic unsupervised classification of all SDSS/DR7 galaxy spectra
• Application of Convolutional Neural Networks for Stellar Spectral Classification
• Dimensionality Reduction of SDSS Spectra with Variational Autoencoders
• Identifying galaxies, quasars, and stars with machine learning: A new catalogue of classifications for 111 million SDSS sources without spectra
• Innocent Bystanders: Carbon Stars from the Sloan Digital Sky Survey
• Carbon stars identified from LAMOST DR4 using Machine Learning
• Anomaly detection for machine learning redshifts applied to SDSS galaxies
• Lithium-rich Giants in LAMOST Survey. I. The Catalog
• A machine learning approach for identification and classification of symbiotic stars using 2MASS and WISE
• Detecting outliers in astronomical images with deep generative networks
• SpecPro: An Interactive IDL Program for Viewing and Analyzing Astronomical Spectra
• DASH: Deep Learning for the Automated Spectral Classification of Supernovae and their Hosts
• The miniJPAS survey: star-galaxy classification using machine learning
• The VIMOS Public Extragalactic Redshift Survey (VIPERS). A Support Vector Machine classification of galaxies, stars and AGNs
• M dwarf catalog of LAMOST pilot survey
• Machine learning Applied to Star-Galaxy-QSO Classification and Stellar Effective Temperature Regression
• The Spectroscopic Binaries from LAMOST Medium-Resolution Survey (MRS). I. Searching for Double-lined Spectroscopic Binaries (SB2s) with Convolutional Neural Network
• Anomaly Detection in the Open Supernova Catalog
• Detecting outliers and learning complex structures with large spectroscopic surveys - a case study with APOGEE stars
• Classification of Broad Absorption Line Quasars with a Convolutional Neural Network
• Spectral classification and composites of galaxies in LAMOST DR4
• Optimal strategies for identifying quasars in DESI
• Imbalance Learning for Variable Star Classification
• Classification of Stellar Spectra with LLE
• Quantitative spectral classification of Galactic O stars
• Stellar Spectra Classification and Feature evaluation Based on Random Forest
• Automated identification of 2612 late-k and M dwarfs in the LAMOST commissioining data using the classification template fits
• Data mining techniques on astronomical spectra data. I : Clustering Analysis
• Automated novelty detection in the WISE survey with one-class support vector machines
• The PAU Survey: star-galaxy classification with multi narrow-band data
• Meta Classification for Variable Stars
• SNIascore: Deep Learning Classification of Low-Resolution Supernova Spectra
• Multiwavelength Spectral Analysis and Neural Network Classification of Counterparts to 4FGL Unassociated Sources
• Quasar Lenses and Galactic Streams: Outlier Selection and GAIA Multiplet Detection
• The Good, the Bad and the Ugly: Statistical quality assessment of SZ detections
• An Extragalactic Spectroscopic Survey of the SSA22 Field
• Double-peak emission line galaxies in the SDSS catalogue. A minor merger sequence
• Star-galaxy separation in the AKARI NEP Deep Field
• A machine-learning photometric classifier for massive stars in nearby galaxies I. The method
• Active deep learning method for the discovery of objects of interest in large spectroscopic surveys
• Classification of 4XMM-DR9 Sources by Machine Learning
• A semi-empirical library of galaxy spectra for Gaia classification based on SDSS data and PEGASE models
• Spectral feature extraction for DB white dwarfs through machine learning applied to new discoveries in the SDSS DR12 and DR14
• Learning from the machine: interpreting machine learning algorithms for point- and extended- source classification
• Spectral classification of B stars: The empirical sequence using SDSS-IV/APOGEE near-IR data
• Searching for hot subdwarf stars from the LAMOST spectra. III. classifying the hot subdwarf stars from LAMOST DR4 using deep learning method
• A search for variable subdwarf B stars in TESS Full Frame Images II. Variable objects in the northern ecliptic hemisphere
• An Efficient Method for Rare Spectra Retrieval in Astronomical Databases
• Deep Learning in Searching the Spectroscopic Redshift of Quasars
• The GALAH survey: a catalogue of carbon-enhanced stars and CEMP candidates
• White dwarfs identified in LAMOST Data Release 5
• Recognition of M-type stars in the unclassified spectra of LAMOST DR5 using a hash learning method
• A new automated tool for the spectral classification of OB stars
• Template matching method for the analysis of interstellar cloud structure
• Machine Learning applied to Multifrequency Data in Astrophysics: Blazar Classification
• Machine learning techniques to select Be star candidates. An application in the OGLE-IV Gaia south ecliptic pole field
• A Machine Learning Approach For Classifying Low-mass X-ray Binaries Based On Their Compact Object Nature
• Stellar Spectra Models Classification and Parameter Estimation Using Machine Learning Algorithms
• Automated Spectral Classification of Galaxies using Machine Learning Approach on Alibaba Cloud AI platform (PAI)
• Classifying Seyfert galaxies with deep learning
• STag: Supernova Tagging and Classification
• Spectroscopic observations of the machine-learning selected anomaly catalogue from the AllWISE Sky Survey
• Informative Bayesian model selection for RR Lyrae star classifiers
• Solar activity classification based on Mg II spectra: towards classification on compressed data
• A novel stellar spectrum denoising method based on deep Bayesian modeling
• Artificial Neural Network for search for metal poor galaxies
• Extreme adaptive optics astrometry of R136. Searching for high proper motion stars
• Centroid Based Binary Tree Structured SVM for Multi Classification
• Search for Ultraviolet Luminous Objects in GALEX data

Cited by in corpus (3)

• An in-depth exploration of LAMOST Unknown spectra based on density clustering
• FNet II: Spectral Classification of Quasars, Galaxies, Stars, and broad absorption line (BAL) Quasars
• How to set up your first machine learning project in astronomy