A review of unsupervised learning in astronomy

Abstract

This review summarizes popular unsupervised learning methods, and gives an overview of their past, current, and future uses in astronomy. Unsupervised learning aims to organise the information content of a dataset, in such a way that knowledge can be extracted. Traditionally this has been achieved through dimensionality reduction techniques that aid the ranking of a dataset, for example through principal component analysis or by using auto-encoders, or simpler visualisation of a high dimensional space, for example through the use of a self organising map. Other desirable properties of unsupervised learning include the identification of clusters, i.e. groups of similar objects, which has traditionally been achieved by the k-means algorithm and more recently through density-based clustering such as HDBSCAN. More recently, complex frameworks have emerged, that chain together dimensionality reduction and clustering methods. However, no dataset is fully unknown. Thus, nowadays a lot of research has been directed towards self-supervised and semi-supervised methods that stand to gain from both supervised and unsupervised learning.

arXiv comment30 pages, 6 figures. Invited contribution to special issue in Astronomy & Computing

References in corpus (193)

• Scikit-learn: Machine Learning in Python
• Auto-Encoding Variational Bayes
• Astropy: A Community Python Package for Astronomy
• Stellar population synthesis at the resolution of 2003
• The Sloan Digital Sky Survey: Technical Summary
• UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
• A Simple Framework for Contrastive Learning of Visual Representations
• The Seventh Data Release of the Sloan Digital Sky Survey
• Nine-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Final Maps and Results
• The Cosmic Evolution Survey (COSMOS) -- Overview
• Planck 2013 results. I. Overview of products and scientific results
• The Sloan Digital Sky Survey Photometric Camera
• K-corrections and filter transformations in the ultraviolet, optical, and near infrared
• The Ninth Data Release of the Sloan Digital Sky Survey: First Spectroscopic Data from the SDSS-III Baryon Oscillation Spectroscopic Survey
• TEMPO2, a new pulsar timing package. I: Overview
• SEGUE: A Spectroscopic Survey of 240,000 stars with g=14-20
• Planck 2015 results. XI. CMB power spectra, likelihoods, and robustness of parameters
• A Gaia DR2 view of the Open Cluster population in the Milky Way
• The SuperCOSMOS Sky Survey. Paper I: Introduction and Description
• The Spitzer Survey of Stellar Structure in Galaxies (S^4G)
• Detection methods for stochastic gravitational-wave backgrounds: a unified treatment
• Unsupervised learning of phase transitions: from principal component analysis to variational autoencoders
• The Sloan Digital Sky Survey Quasar Catalog: Fourteenth Data Release
• Kepler Eclipsing Binary Stars. VII. The Catalog of Eclipsing Binaries Found in the Entire Kepler Data-Set
• Streams, substructures and the early history of the Milky Way
• Data Mining and Machine Learning in Astronomy
• PynPoint: An Image Processing Package for Finding Exoplanets
• Slicing Through Multicolor Space: Galaxy Redshifts From Broadband Photometry
• Eigenvector 1: An Optimal Correlation Space for Active Galactic Nuclei
• Three types of gamma-ray bursts
• A catalog of visual-like morphologies in the 5 CANDELS fields using deep-learning
• Reconstructing the stellar mass distributions of galaxies using S4G IRAC 3.6 and 4.5 micron images: II. The conversion from light to mass
• PHAT: PHoto-z Accuracy Testing
• A strong redshift dependence of the broad absorption line quasar fraction
• Untangling the Galaxy I: Local Structure and Star Formation History of the Milky Way
• Mapping the Galaxy Color-Redshift Relation: Optimal Photometric Redshift Calibration Strategies for Cosmology Surveys
• A new method for unveiling Open Clusters in Gaia: new nearby Open Clusters confirmed by DR2
• UPMASK: unsupervised photometric membership assignment in stellar clusters
• Kepler Eclipsing Binary Stars. III. Classification of Kepler Eclipsing Binary Light Curves with Locally Linear Embedding
• Deep Transfer Learning: A new deep learning glitch classification method for advanced LIGO
• Glitch Classification and Clustering for LIGO with Deep Transfer Learning
• Galaxy Zoo: Probabilistic Morphology through Bayesian CNNs and Active Learning
• Oscillation frequencies for 35 \Kepler solar-type planet-hosting stars using Bayesian techniques and machine learning
• Machine Learning in Astronomy: a practical overview
• Hunting for open clusters in \textit{Gaia} DR2: the Galactic anticentre
• Searching For the Physical Drivers of Eigenvector 1: Influence of Black Hole Mass and Eddington Ratio
• The weirdest SDSS galaxies: results from an outlier detection algorithm
• Automated Classification of Stellar Spectra. II: Two-Dimensional Classification with Neural Networks and Principal Components Analysis
• Photometric Redshift Calibration with Self Organising Maps
• SOMz: photometric redshift PDFs with self organizing maps and random atlas
• Tidal Streams of Intracluster Light
• Euclid preparation: X. The Euclid photometric-redshift challenge
• K2 Variable Catalogue II: Machine Learning Classification of Variable Stars and Eclipsing Binaries in K2 Fields 0-4
• SKYNET: an efficient and robust neural network training tool for machine learning in astronomy
• Neural computation as a tool for galaxy classification : methods and examples
• Expanding associations in the Vela-Puppis region: 3D structure and kinematics of the young population
• Galaxies, Human Eyes and Artificial Neural Networks
• Estimating stellar atmospheric parameters, absolute magnitudes and elemental abundances from the LAMOST spectra with Kernel-based Principal Component Analysis
• SuperRAENN: A Semi-supervised Supernova Photometric Classification Pipeline Trained on Pan-STARRS1 Medium Deep Survey Supernovae
• The DESI Survey Validation: Results from Visual Inspection of the Quasar Survey Spectra
• An automatic taxonomy of galaxy morphology using unsupervised machine learning
• Object Classification in Astronomical Multi-Color Surveys
• Computational Intelligence Challenges and Applications on Large-Scale Astronomical Time Series Databases
• Galaxy morphological classification in deep-wide surveys via unsupervised machine learning
• A hybrid supervised/unsupervised machine learning approach to solar flare prediction
• Automatic unsupervised classification of all SDSS/DR7 galaxy spectra
• Identifying Strong Lenses with Unsupervised Machine Learning using Convolutional Autoencoder
• Unsupervised self-organised mapping: a versatile empirical tool for object selection, classification and redshift estimation in large surveys
• A new method for classifying galaxy SEDs from multi-wavelength photometry
• Ensemble Learning Independent Component Analysis of Normal Galaxy Spectra
• Light curve analysis of Variable stars using Fourier decomposition and Principal component analysis
• How Sample Completeness Affects Gamma-Ray Burst Classification
• Astronomaly: Personalised Active Anomaly Detection in Astronomical Data
• Identifying galaxies, quasars, and stars with machine learning: A new catalogue of classifications for 111 million SDSS sources without spectra
• Wide Field Imaging. I. Applications of Neural Networks to object detection and star/galaxy classification
• Astronomia ex machina: a history, primer, and outlook on neural networks in astronomy
• Modelling type 1 quasar colours in the era of Rubin and Euclid
• Kernel PCA for type Ia supernovae photometric classification
• Deep BVR photometry of the Chandra Deep Field South from the COMBO-17 survey
• Beyond the Hubble Sequence -- Exploring Galaxy Morphology with Unsupervised Machine Learning
• Blind extraction of an exoplanetary spectrum through Independent Component Analysis
• Automated Galaxy Morphology: A Fourier Approach
• Data Mining for Gravitationally Lensed Quasars
• A Machine Learning Based Morphological Classification of 14,245 Radio AGNs Selected From The Best-Heckman Sample
• Unsupervised star, galaxy, qso classification: Application of HDBSCAN
• Reducing the Dimensionality of Data: Locally Linear Embedding of Sloan Galaxy Spectra
• Interpreting the Ionization Sequence in AGN Emission-Line Spectra
• Automated classification of variable stars for ASAS 1-2 data
• Cataloging the radio-sky with unsupervised machine learning: a new approach for the SKA era
• The GOGREEN survey: Post-infall environmental quenching fails to predict the observed age difference between quiescent field and cluster galaxies at z>1
• Reconstruction of the Primordial Power Spectrum by Direct Inversion
• Radio Galaxy Zoo: Unsupervised Clustering of Convolutionally Auto-encoded Radio-astronomical Images
• A Hybrid Ensemble Learning Approach to Star-Galaxy Classification
• Systematic Serendipity: A Test of Unsupervised Machine Learning as a Method for Anomaly Detection
• Semi-supervised Learning for Photometric Supernova Classification
• Uncloaking hidden repeating fast radio bursts with unsupervised machine learning
• The narrow-line region of narrow-line and broad-line type 1 AGN I. A zone of avoidance in density
• AstroVaDEr: Astronomical Variational Deep Embedder for Unsupervised Morphological Classification of Galaxies and Synthetic Image Generation
• Kinematic decomposition of IllustrisTNG disk galaxies: morphology and relation with morphological structures
• Deep Learning at Scale for the Construction of Galaxy Catalogs in the Dark Energy Survey
• Unveiling the rarest morphologies of the LOFAR Two-metre Sky Survey radio source population with self-organised maps
• Changing-look active galactic nuclei: close binaries of supermassive black holes in action
• The GALAH survey: properties of the Galactic disk(s) in the solar neighbourhood
• Identifying kinematic structures in simulated galaxies using unsupervised machine learning
• Detecting outliers and learning complex structures with large spectroscopic surveys - a case study with APOGEE stars
• Unsupervised clustering of Type II supernova light curves
• Low mass young stars in the Milky Way unveiled by DBSCAN and Gaia EDR3. Mapping the star forming regions within 1.5 Kpc
• Automated Source Classification using a Kohonen Network
• Denoising Gravitational Waves with Enhanced Deep Recurrent Denoising Auto-Encoders
• An independent analysis of the Spitzer/IRAC phase curves of WASP43 b
• Denoising Gravitational Waves using Deep Learning with Recurrent Denoising Autoencoders
• Stellar classification from single-band imaging using machine learning
• Multivariate Approaches to Classification in Extragalactic Astronomy
• Can Self-Organizing Maps accurately predict photometric redshifts?
• Unveiling hidden stellar aggregates in the Milky Way: 1656 new star clusters found in Gaia EDR3
• Optimizing exoplanet atmosphere retrieval using unsupervised machine-learning classification
• Anomaly detection in Hyper Suprime-Cam galaxy images with generative adversarial networks
• Classification of Stellar Spectra with LLE
• Unsupervised machine learning for transient discovery in Deeper, Wider, Faster light curves
• Automated unsupervised classification of the Sloan Digital Sky Survey stellar spectra using k-means clustering
• Exploring the spectroscopic diversity of type Ia supernovae with DRACULA: a machine learning approach
• New Coronae and Stellar Associations Revealed by a Clustering Analysis of the Solar Neighborhood
• Discovery of new stellar groups in the Orion complex
• {\sc mirkwood:} Fast and Accurate SED Modeling Using Machine Learning
• Machine Learning of Interstellar Chemical Inventories
• COSMOS2020: Manifold Learning to Estimate Physical Parameters in Large Galaxy Surveys
• Classification and analysis of emission-line galaxies using mean field independent component analysis
• Unsupervised classification of eclipsing binary light curves through k-medoids clustering
• A Method to Distinguish Quiescent and Dusty Star-forming Galaxies with Machine Learning
• Stacking for machine learning redshifts applied to SDSS galaxies
• A novel single-pulse search approach to detection of dispersed radio pulses using clustering and supervised machine learning
• Deep Neural Network Classifier for Variable Stars with Novelty Detection Capability
• Hunting for C-rich long-period variable stars in the Milky Way's bar-bulge using unsupervised classification of Gaia BP/RP spectra
• Deep Learning Assisted Data Inspection for Radio Astronomy
• Estimating Extinction using Unsupervised Machine Learning
• Unsupervised Galaxy Morphological Visual Representation with Deep Contrastive Learning
• Machine learning in APOGEE: Unsupervised spectral classification with $K$-means
• Discovery of Peculiar Radio Morphologies with ASKAP using Unsupervised Machine Learning
• Capturing the physics of MaNGA galaxies with self-supervised Machine Learning
• Unsupervised feature-learning for galaxy SEDs with denoising autoencoders
• Autoencoding Galaxy Spectra II: Redshift Invariance and Outlier Detection
• A Robust Study of High-Redshift Galaxies: Unsupervised Machine Learning for Characterising morphology with JWST up to z ~ 8
• Automatic Survey-Invariant Variable Star Classification
• The membership of stars, density profile and mass segregation in open clusters using a new machine learning-based method
• SKA Science Data Challenge 2: analysis and results
• Mapping the Diversity of Galaxy Spectra with Deep Unsupervised Machine Learning
• The Oceanus Moving Group: A New 500 Myr-Old Host for the Nearest Brown Dwarf
• Unsupervised Learning Architecture for Classifying the Transient Noise of Interferometric Gravitational-wave Detectors
• Classification of OGLE eclipsing binary stars based on their morphology type with Locally Linear Embedding
• ASTErIsM - Application of topometric clustering algorithms in automatic galaxy detection and classification
• Comparative clustering analysis of variable stars in the Hipparcos, OGLE Large Magellanic Cloud and CoRoT exoplanet databases
• Machine learning in APOGEE: Identification of stellar populations through chemical abundances
• Cleaning foregrounds from single-dish 21cm intensity maps with Kernel Principal Component Analysis
• Massive young stellar objects in the Local Group irregular galaxy NGC6822 identified using machine learning
• A Gaia astrometric view of the open clusters Pleiades, Praesepe and Blanco 1
• The GALAH survey: a catalogue of carbon-enhanced stars and CEMP candidates
• The Deeper, Wider, Faster Program: Exploring stellar flare activity with deep, fast cadenced DECam imaging via machine learning
• Unsupervised Classification of Galaxies. I. ICA feature selection
• Identifying outliers in astronomical images with unsupervised machine learning
• Physics-aware Machine Learning Revolutionizes Scientific Paradigm for Machine Learning and Process-based Hydrology
• Possible Evidence of a Universal Radio/X-ray Correlation in a near-Complete Sample of Hard X-ray Selected Seyfert Galaxies
• Soft clustering analysis of galaxy morphologies: A worked example with SDSS
• Visualizing and Interpreting Unsupervised Solar Wind Classifications
• Gaia eclipsing binary and multiple systems. Supervised classification and self-organizing maps
• Galaxy And Mass Assembly (GAMA): Self-Organizing Map Application on Nearby Galaxies
• Mapping the X-ray variability of GRS1915+105 with machine learning
• X-ray Study of Spatial Structures in Tycho's Supernova Remnant Using Unsupervised Deep Learning
• Inner and outer rings are not strongly coupled with stellar bars
• CLaSPS: a new methodology for Knowledge extraction from complex astronomical dataset
• Tidal debris from Omega Centauri discovered with unsupervised machine learning
• Milky Way-like galaxies: stellar population properties of dynamically defined disks, bulges and stellar halos
• The bimodality of the 10k zCOSMOS-bright galaxies up to z ~ 1: a new statistical and portable classification based on the optical galaxy properties
• TSARDI: a Machine Learning data rejection algorithm for transiting exoplanet light curves
• Labeling Bias in Galaxy Morphologies
• Clustering clusters: unsupervised machine learning on globular cluster structural parameters
• Classifying a frequently repeating fast radio burst, FRB 20201124A, with unsupervised machine learning
• Unsupervised spectral decomposition of X-ray binaries with application to GX 339-4
• Mapping the Similarities of Spectra: Global and Locally-biased Approaches to SDSS Galaxy Data
• A machine learning approach for GRB detection in AstroSat CZTI data
• Stellar Cluster Detection using GMM with Deep Variational Autoencoder
• Classification of local ultraluminous infrared galaxies and quasars with kernel principal component analysis
• Insights into Quasar UV Spectra Using Unsupervised Clustering Analysis
• Automated reliability assessment for spectroscopic redshift measurements
• Robust Assessment of Clustering Methods for Fast Radio Transient Candidates
• Self-Supervised Clustering on Image-Subtracted Data with Deep-Embedded Self-Organizing Map
• Optimising the shape of photometric redshift distributions with clustering cross-correlations
• AstronomicAL: An interactive dashboard for visualisation, integration and classification of data using Active Learning
• Learning Reionization History from Quasars with Simulation-Based Inference
• Applying unsupervised learning to resolve evolutionary histories and explore the galaxy-halo connection in IllustrisTNG
• DeepAstroUDA: Semi-Supervised Universal Domain Adaptation for Cross-Survey Galaxy Morphology Classification and Anomaly Detection
• Unsupervised Method for Correlated Noise Removal for Multi-wavelength Exoplanet Transit Observations
• Gravitational Dimensionality Reduction Using Newtonian Gravity and Einstein's General Relativity
• Interpreting Stellar Spectra with Unsupervised Domain Adaptation

Cited by in corpus (12)

• Wide Area VISTA Extra-galactic Survey (WAVES): Unsupervised star-galaxy separation on the WAVES-Wide photometric input catalogue using UMAP and $\mathrm{HDBSCAN}$
• Unsupervised Machine Learning for Classifying CHIME Fast Radio Bursts and Investigating Empirical Relations
• Explainable autoencoder for neutron star dense matter parameter estimation
• Which is which? Identification of the two compact objects in gravitational-wave binaries
• Semi-supervised classification of stars, galaxies and quasars using K-means and random-forest approaches
• How to set up your first machine learning project in astronomy
• Navigating AGN variability with self-organizing maps
• Identifying Radio Active Galactic Nuclei with Machine Learning and Large-Area Surveys
• Deblending the MIGHTEE-COSMOS survey with XID+: The resolved radio source counts to $S_{1.4}\approx 5\mu$Jy
• Deciphering galaxy images using machine vision -- Combining variational autoencoder and principal component analysis for feature extraction
• Extracting latent representations from X-ray spectra. Classification, regression, and accretion signatures of Chandra sources
• Estimating the peak energy of Swift gamma-ray bursts using supervised machine learning