Rotation and flipping invariant self-organizing maps with astronomical images: A cookbook and application to the VLA Sky Survey QuickLook images

Abstract

Modern wide field radio surveys typically detect millions of objects. Techniques based on machine learning are proving to be useful for classifying large numbers of objects. The self-organizing map (SOM) is an unsupervised machine learning algorithm that projects a many-dimensional dataset onto a two- or three-dimensional lattice of neurons. This dimensionality reduction allows the user to visualize common features of the data better and develop algorithms for classifying objects that are not otherwise possible with large datasets. To this aim, we use the PINK implementation of a SOM. PINK incorporates rotation and flipping invariance so that the SOM algorithm may be applied to astronomical images. In this cookbook we provide instructions for working with PINK, including preprocessing the input images, training the model, and offering lessons learned through experimentation. The problem of imbalanced classes can be improved by careful selection of the training sample and increasing the number of neurons in the SOM (chosen by the user). Because PINK is not scale-invariant, structure can be smeared in the neurons. This can also be improved by increasing the number of neurons in the SOM. We also introduce pyink, a Python package used to read and write PINK binary files, assist in common preprocessing operations, perform standard analyses, visualize the SOM and preprocessed images, and create image-based annotations using a graphical interface. A tutorial is also provided to guide the user through the entire process. We present an application of PINK to VLA Sky Survey (VLASS) images. We demonstrate that the PINK is generally able to group VLASS sources with similar morphology together. We use the results of PINK to estimate the probability that a given source in the VLASS QuickLook Catalogue is actually due to sidelobe contamination.

arXiv commentAccepted for publication in Astronomy and Computing

References in corpus (20)

• SMOTE: Synthetic Minority Over-sampling Technique
• The Wide-field Infrared Survey Explorer (WISE): Mission Description and Initial On-orbit Performance
• The LOFAR Two-metre Sky Survey - I. Survey Description and Preliminary Data Release
• The unWISE Catalog: Two Billion Infrared Sources from Five Years of WISE Imaging
• unWISE: unblurred coadds of the WISE imaging
• A Quick Look at the $3$GHz Radio Sky I. Source Statistics from the Very Large Array Sky Survey
• Mapping the Galaxy Color-Redshift Relation: Optimal Photometric Redshift Calibration Strategies for Cosmology Surveys
• Classifying Radio Galaxies with Convolutional Neural Network
• Radio Galaxy Zoo: host galaxies and radio morphologies derived from visual inspection
• Photometric Redshift Calibration with Self Organising Maps
• SOMz: photometric redshift PDFs with self organizing maps and random atlas
• K2 Variable Catalogue II: Machine Learning Classification of Variable Stars and Eclipsing Binaries in K2 Fields 0-4
• Radio Galaxy Zoo: ClaRAN - A Deep Learning Classifier for Radio Morphologies
• The automated classification of astronomical lightcurves using Kohonen self-organising maps
• Cataloging the radio-sky with unsupervised machine learning: a new approach for the SKA era
• Unusual quasars from the Sloan Digital Sky Survey selected by means of Kohonen self-organising maps
• Radio Galaxy Zoo: Machine learning for radio source host galaxy cross-identification
• Unveiling the rarest morphologies of the LOFAR Two-metre Sky Survey radio source population with self-organised maps
• Fanaroff-Riley classification of radio galaxies using group-equivariant convolutional neural networks
• Radio Galaxy Zoo: Knowledge Transfer Using Rotationally Invariant Self-Organising Maps

Cited by in corpus (6)

• A catalogue of complex radio sources in the Rapid ASKAP Continuum Survey created using a Self-Organising Map
• EMU and the DRAGNs I: A Catalogue of DRAGNs
• Classification of Radio Sources Through Self-Supervised Learning
• astromorph: Self-supervised machine learning pipeline for astronomical morphology analysis
• DRAGNs in the Forest: Identifying Artifacts with Random Forest Models in the VLASS DRAGNs Catalog
• Linking Young Stellar Object Morphology to Evolutionary Stages with Self-Organizing Maps