Realistic galaxy image simulation via score-based generative models
arXiv:2111.01713 · doi:10.1093/mnras/stac130
Abstract
We show that a Denoising Diffusion Probabalistic Model (DDPM), a class of score-based generative model, can be used to produce realistic mock images that mimic observations of galaxies. Our method is tested with Dark Energy Spectroscopic Instrument (DESI) grz imaging of galaxies from the Photometry and Rotation curve OBservations from Extragalactic Surveys (PROBES) sample and galaxies selected from the Sloan Digital Sky Survey. Subjectively, the generated galaxies are highly realistic when compared with samples from the real dataset. We quantify the similarity by borrowing from the deep generative learning literature, using the `Fréchet Inception Distance' to test for subjective and morphological similarity. We also introduce the `Synthetic Galaxy Distance' metric to compare the emergent physical properties (such as total magnitude, colour and half light radius) of a ground truth parent and synthesised child dataset. We argue that the DDPM approach produces sharper and more realistic images than other generative methods such as Adversarial Networks (with the downside of more costly inference), and could be used to produce large samples of synthetic observations tailored to a specific imaging survey. We demonstrate two potential uses of the DDPM: (1) accurate in-painting of occluded data, such as satellite trails, and (2) domain transfer, where new input images can be processed to mimic the properties of the DDPM training set. Here we `DESI-fy' cartoon images as a proof of concept for domain transfer. Finally, we suggest potential applications for score-based approaches that could motivate further research on this topic within the astronomical community.
arXiv comment11 pages, 8 figures. Code: https://github.com/smith42/astroddpm . Follow the Twitter bot @ThisIsNotAnApod for DDPM-generated APODs
References in corpus (33)
- The Sloan Digital Sky Survey: Technical Summary
- The Seventh Data Release of the Sloan Digital Sky Survey
- The many lives of active galactic nuclei: cooling flows, black holes and the luminosities and colours of galaxies
- The EAGLE project: Simulating the evolution and assembly of galaxies and their environments
- LSST: from Science Drivers to Reference Design and Anticipated Data Products
- The broken hierarchy of galaxy formation
- Introducing the Illustris Project: Simulating the coevolution of dark and visible matter in the Universe
- Hierarchical Galaxy Formation
- Overview of the DESI Legacy Imaging Surveys
- Semi-Analytic Modelling of Galaxy Formation: The Local Universe
- Dancing in the dark: galactic properties trace spin swings along the cosmic web
- The MassiveBlack-II Simulation: The Evolution of Halos and Galaxies to z~0
- Generative Adversarial Networks recover features in astrophysical images of galaxies beyond the deconvolution limit
- The Horizon-AGN simulation: evolution of galaxy properties over cosmic time
- Optical colours and spectral indices of EAGLE galaxies with 3D dust radiative transfer code SKIRT
- Far-infrared and dust properties of present-day galaxies in the EAGLE simulations
- CosmoGAN: creating high-fidelity weak lensing convergence maps using Generative Adversarial Networks
- From the far-ultraviolet to the far-infrared -- galaxy emission at in the Shark semi-analytic model
- Reproducing sub-millimetre galaxy number counts with cosmological hydrodynamic simulations
- The proliferation of space objects is a rapidly increasing source of artificial night sky brightness
- A multiscale approach to environment and its influence on the colour distribution of galaxies
- Deblending galaxy superpositions with branched generative adversarial networks
- Deep Generative Models for Galaxy Image Simulations
- Euclid Mission: building of a Reference Survey
- AstroVaDEr: Astronomical Variational Deep Embedder for Unsupervised Morphological Classification of Galaxies and Synthetic Image Generation
- Deblending galaxies with Variational Autoencoders: a joint multi-band, multi-instrument approach
- Forging new worlds: high-resolution synthetic galaxies with chained generative adversarial networks
- The Intrinsic Scatter of Galaxy Scaling Relations
- The Intrinsic Scatter of the Radial Acceleration Relation
- Generative deep fields: arbitrarily sized, random synthetic astronomical images through deep learning
- PSFGAN: a generative adversarial network system for separating quasar point sources and host galaxy light
- Survey2Survey: A deep learning generative model approach for cross-survey image mapping
- On The Role of Supermassive Black Holes in Quenching Star Formation in Local Central Galaxies
Cited by in corpus (4)
- The DAWES review 10: The impact of deep learning for the analysis of galaxy surveys
- Astronomia ex machina: a history, primer, and outlook on neural networks in astronomy
- Probabilistic Mass Mapping with Neural Score Estimation
- Realistic galaxy images and improved robustness in machine learning tasks from generative modelling