Anomaly detection in Hyper Suprime-Cam galaxy images with generative adversarial networks
arXiv:2105.02434 · doi:10.1093/mnras/stab2589
Abstract
The problem of anomaly detection in astronomical surveys is becoming increasingly important as data sets grow in size. We present the results of an unsupervised anomaly detection method using a Wasserstein generative adversarial network (WGAN) on nearly one million optical galaxy images in the Hyper Suprime-Cam (HSC) survey. The WGAN learns to generate realistic HSC-like galaxies that follow the distribution of the data set; anomalous images are defined based on a poor reconstruction by the generator and outlying features learned by the discriminator. We find that the discriminator is more attuned to potentially interesting anomalies compared to the generator, and compared to a simpler autoencoder-based anomaly detection approach, so we use the discriminator-selected images to construct a high-anomaly sample of 13,000 objects. We propose a new approach to further characterize these anomalous images: we use a convolutional autoencoder to reduce the dimensionality of the residual differences between the real and WGAN-reconstructed images and perform UMAP clustering on these. We report detected anomalies of interest including galaxy mergers, tidal features, and extreme star-forming galaxies. A follow-up spectroscopic analysis of one of these anomalies is detailed in the Appendix; we find that it is an unusual system most likely to be a metal-poor dwarf galaxy with an extremely blue, higher-metallicity HII region. We have released a catalog with the WGAN anomaly scores; the code and catalog are available at https://github.com/kstoreyf/anomalies-GAN-HSC, and our interactive visualization tool for exploring the clustered data is at https://weirdgalaxi.es.
arXiv commentPublished in MNRAS
References in corpus (35)
- The Sloan Digital Sky Survey: Technical Summary
- The Host Galaxies of AGN
- LSST: from Science Drivers to Reference Design and Anticipated Data Products
- Theoretical Modeling of Starburst Galaxies
- The Hyper Suprime-Cam SSP Survey: Overview and Survey Design
- First Data Release of the Hyper Suprime-Cam Subaru Strategic Program
- Galaxy Zoo Green Peas: Discovery of A Class of Compact Extremely Star-Forming Galaxies
- Second Data Release of the Hyper Suprime-Cam Subaru Strategic Program
- The Hyper Suprime-Cam Software Pipeline
- Preparing Red-Green-Blue (RGB) Images from CCD Data
- The first-year shear catalog of the Subaru Hyper Suprime-Cam SSP Survey
- Galaxy Interactions Trigger Rapid Black Hole Growth: an unprecedented view from the Hyper Suprime-Cam Survey
- Ultraviolet spectra of extreme nearby star-forming regions --- approaching a local reference sample for JWST
- Blueberry galaxies: the lowest mass young starbursts
- The weirdest SDSS galaxies: results from an outlier detection algorithm
- Direct Estimation of Spinal Cobb Angles by Structured Multi-Output Regression
- Ionised gas outflow signatures in SDSS-IV MaNGA active galactic nuclei
- Astronomaly: Personalised Active Anomaly Detection in Astronomical Data
- Survey of Gravitationally-lensed Objects in HSC Imaging (SuGOHI). II. Environments and Line-of-Sight Structure of Strong Gravitational Lens Galaxies to z ~ 0.8
- Probabilistic selection of high-redshift quasars
- A large sample of shear selected clusters from the Hyper Suprime-Cam Subaru Strategic Program S16A wide field mass maps
- Detecting outliers in astronomical images with deep generative networks
- Incidence, scaling relations and physical conditions of ionised gas outflows in MaNGA
- Systematic Serendipity: A Test of Unsupervised Machine Learning as a Method for Anomaly Detection
- A Deep Learning Approach for Active Anomaly Detection of Extragalactic Transients
- Anomaly Detection in the Open Supernova Catalog
- Imaging Extended Emission-Line Regions of Obscured AGN with the Subaru Hyper Suprime-Cam Survey
- Automated novelty detection in the WISE survey with one-class support vector machines
- Ultracompact Blue Dwarf Galaxies: Hubble Space Telescope Imaging and Stellar Population Analysis
- Do Galaxy Morphologies Really Affect the Efficiency of Star Formation during the Phase of Galaxy Transition?
- Identifying complex sources in large astronomical data using a coarse-grained complexity measure
- Chemical Self-Enrichment of HII Regions by the Wolf-Rayet Phase of an 85 Msun star
- Stellar Populations Found in the Central kpc of Four Luminous Compact Blue Galaxies at Intermediate Redshift
- The Discovery of QSOs Behind M31 and M33
- Anomaly detection in Astrophysics: a comparison between unsupervised Deep and Machine Learning on KiDS data
Cited by in corpus (22)
- The DAWES review 10: The impact of deep learning for the analysis of galaxy surveys
- The CAMELS Multifield Dataset: Learning the Universe's Fundamental Parameters with Artificial Intelligence
- Practical Galaxy Morphology Tools from Deep Supervised Representation Learning
- A review of unsupervised learning in astronomy
- Machine Learning for Observational Cosmology
- A method for finding anomalous astronomical light curves and their analogs
- Preparing to discover the unknown with Rubin LSST -- I: Time domain
- Astronomaly at scale: searching for anomalies amongst 4 million galaxies
- The ROAD to discovery: machine learning-driven anomaly detection in radio astronomy spectrograms
- HOLISMOKES -- XI. Evaluation of supervised neural networks for strong-lens searches in ground-based imaging surveys
- Supernova search with active learning in ZTF DR3
- Searching for Anomalies in the ZTF Catalog of Periodic Variable Stars
- De-noising of galaxy optical spectra with autoencoders
- SNAD Transient Miner: Finding Missed Transient Events in ZTF DR4 using k-D trees
- The emptiness inside: Finding gaps, valleys, and lacunae with geometric data analysis
- Investigation on deep learning-based galaxy image translation models
- Quantitatively rating galaxy simulations against real observations with anomaly detection
- Exploring the Universe with SNAD: Anomaly Detection in Astronomy
- Bridging Simulations and Observations: New Insights into Galaxy Formation Simulations via Out-of-Distribution Detection and Bayesian Model Comparison
- J-PLUS: Understanding outlier white dwarfs in the third data release via dimensionality reduction
- Extracting latent representations from X-ray spectra. Classification, regression, and accretion signatures of Chandra sources
- Passive spiral galaxies deeply captured by Subaru Hyper Suprime-Cam