Galaxy Morphological Classification with Efficient Vision Transformer

Abstract

Quantifying the morphology of galaxies has been an important task in astrophysics to understand the formation and evolution of galaxies. In recent years, the data size has been dramatically increasing due to several on-going and upcoming surveys. Labeling and identifying interesting objects for further investigations has been explored by citizen science through the Galaxy Zoo Project and by machine learning in particular with the convolutional neural networks (CNNs). In this work, we explore the usage of Vision Transformer (ViT) for galaxy morphology classification for the first time. We show that ViT could reach competitive results compared with CNNs, and is specifically good at classifying smaller-sized and fainter galaxies. With this promising preliminary result, we believe the ViT network architecture can be an important tool for galaxy morphological classification for the next generation surveys. Our open source, is publicly available at \url{https://github.com/sliao-mi-luku/Galaxy-Zoo-Classification}

arXiv comment11 pages, 4 figures, accepted by the NeurIPS Machine Learning and the Physical Sciences workshop

References in corpus (26)

• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
• Language Models are Few-Shot Learners
• Galaxy Zoo : Morphologies derived from visual inspection of galaxies from the Sloan Digital Sky Survey
• The size distribution of galaxies in the Sloan Digital Sky Survey
• Wide-Field InfrarRed Survey Telescope-Astrophysics Focused Telescope Assets WFIRST-AFTA 2015 Report
• Linformer: Self-Attention with Linear Complexity
• Rotation-invariant convolutional neural networks for galaxy morphology prediction
• Galaxy Zoo 1 : Data Release of Morphological Classifications for nearly 900,000 galaxies
• Galaxy Zoo 2: detailed morphological classifications for 304,122 galaxies from the Sloan Digital Sky Survey
• Improving galaxy morphologies for SDSS with Deep Learning
• A Catalogue of Morphologically Classified Galaxies from the Sloan Digital Sky Survey: North Equatorial Region
• Galaxy Zoo: comparing the demographics of spiral arm number and a new method for correcting redshift bias
• Galaxy Morphology Classification with Deep Convolutional Neural Networks
• Optimising Automatic Morphological Classification of Galaxies with Machine Learning and Deep Learning using Dark Energy Survey Imaging
• Galaxy Zoo: Quantitative Visual Morphological Classifications for 48,000 galaxies from CANDELS
• Galaxy Zoo: Morphological Classifications for 120,000 Galaxies in HST Legacy Imaging
• An automatic taxonomy of galaxy morphology using unsupervised machine learning
• Integrating human and machine intelligence in galaxy morphology classification tasks
• Beyond the Hubble Sequence -- Exploring Galaxy Morphology with Unsupervised Machine Learning
• Euclid Mission: building of a Reference Survey
• Deep Learning at Scale for the Construction of Galaxy Catalogs in the Dark Energy Survey
• Galaxy Morphology Classification using Neural Ordinary Differential Equations
• Machine Learning for Galaxy Morphology Classification
• Galaxy Morphology Classification using EfficientNet Architectures
• Deep learning for studies of galaxy morphology
• Improving galaxy morphology with machine learning