Enabling Unsupervised Discovery in Astronomical Images through Self-Supervised Representations

Abstract

Unsupervised learning, a branch of machine learning that can operate on unlabelled data, has proven to be a powerful tool for data exploration and discovery in astronomy. As large surveys and new telescopes drive a rapid increase in data size and richness, these techniques offer the promise of discovering new classes of objects and of efficient sorting of data into similar types. However, unsupervised learning techniques generally require feature extraction to derive simple but informative representations of images. In this paper, we explore the use of self-supervised deep learning as a method of automated representation learning. We apply the algorithm Bootstrap Your Own Latent (BYOL) to Galaxy Zoo DECaLS images to obtain a lower dimensional representation of each galaxy, known as features. We briefly validate these features using a small supervised classification problem. We then move on to apply an automated clustering algorithm, demonstrating that this fully unsupervised approach is able to successfully group together galaxies with similar morphology. The same features prove useful for anomaly detection, where we use the framework astronomaly to search for merger candidates. While the focus of this work is on optical images, we also explore the versatility of this technique by applying the exact same approach to a small radio galaxy dataset. This work aims to demonstrate that applying deep representation learning is key to unlocking the potential of unsupervised discovery in future datasets from telescopes such as the Vera C. Rubin Observatory and the Square Kilometre Array.

22 pages, 22 figures, comments welcome

References in corpus (8)

• The Astropy Project: Sustaining and Growing a Community-oriented Open-source Project and the Latest Major Release (v5.0) of the Core Package
• Combining pretrained CNN feature extractors to enhance clustering of complex natural images
• Unsupervised machine learning for transient discovery in Deeper, Wider, Faster light curves
• Discovery of Peculiar Radio Morphologies with ASKAP using Unsupervised Machine Learning
• Unsupervised Galaxy Morphological Visual Representation with Deep Contrastive Learning
• Astronomaly at scale: searching for anomalies amongst 4 million galaxies
• An in-depth exploration of LAMOST Unknown spectra based on density clustering
• The use of neural networks to probe the structure of the nearby universe

Cited by in corpus (9)

• Representation Learning for Time-Domain High-Energy Astrophysics: Discovery of Extragalactic Fast X-ray Transient XRT 200515
• Self-supervised contrastive learning of radio data for source detection, classification and peculiar object discovery
• Finding radio transients with anomaly detection and active learning based on volunteer classifications
• Self-Supervised Learning on MeerKAT Wide-Field Continuum Images
• Discovery of Odd Radio Circles and Other Peculiars in the First Year of the EMU Survey using Object Detection
• Can AI Dream of Unseen Galaxies? Conditional Diffusion Model for Galaxy Morphology Augmentation
• astromorph: Self-supervised machine learning pipeline for astronomical morphology analysis
• Radio Galaxy Zoo: Morphological classification by Fanaroff-Riley designation using self-supervised pre-training
• Enabling New Discoveries with Machine Learning