The DAWES review 10: The impact of deep learning for the analysis of galaxy surveys
arXiv:2210.01813 · doi:10.1017/pasa.2022.55
Abstract
The amount and complexity of data delivered by modern galaxy surveys has been steadily increasing over the past years. Extracting coherent scientific information from these large and multi-modal data sets remains an open issue and data driven approaches such as deep learning have rapidly emerged as a potentially powerful solution to some long lasting challenges. This enthusiasm is reflected in an unprecedented exponential growth of publications using neural networks. Half a decade after the first published work in astronomy mentioning deep learning, we believe it is timely to review what has been the real impact of this new technology in the field and its potential to solve key challenges raised by the size and complexity of the new datasets. In this review we first aim at summarizing the main applications of deep learning for galaxy surveys that have emerged so far. We then extract the major achievements and lessons learned and highlight key open questions and limitations. Overall, state-of-the art deep learning methods are rapidly adopted by the astronomical community, reflecting a democratization of these methods. We show that the majority of works using deep learning up to date are oriented to computer vision tasks. This is also the domain of application where deep learning has brought the most important breakthroughs so far. We report that the applications are becoming more diverse and deep learning is used for estimating galaxy properties, identifying outliers or constraining the cosmological model. Most of these works remain at the exploratory level. Some common challenges will most likely need to be addressed before moving to the next phase of deployment of deep learning in the processing of future surveys; e.g. uncertainty quantification, interpretability, data labeling and domain shift issues from training with simulations, which constitutes a common practice in astronomy.
arXiv commentInvited DAWES review. Accepted for publication in PASA
References in corpus (192)
- Simulating Galaxy Formation with the IllustrisTNG Model
- Galaxy Zoo : Morphologies derived from visual inspection of galaxies from the Sloan Digital Sky Survey
- Bayesian photometric redshift estimation
- Simba: Cosmological Simulations with Black Hole Growth and Feedback
- The Dark Energy Survey: more than dark energy - an overview
- The Relationship Between Stellar Light Distributions of Galaxies and their Formation Histories
- Rotation-invariant convolutional neural networks for galaxy morphology prediction
- ANNz: estimating photometric redshifts using artificial neural networks
- Galaxy Merger Morphologies and Time-Scales from Simulations of Equal-Mass Gas-Rich Disc Mergers
- Data Mining and Machine Learning in Astronomy
- Improving galaxy morphologies for SDSS with Deep Learning
- Solving Large Scale Structure in Ten Easy Steps with COLA
- The CAMELS project: Cosmology and Astrophysics with MachinE Learning Simulations
- A catalog of visual-like morphologies in the 5 CANDELS fields using deep-learning
- Fast Automated Analysis of Strong Gravitational Lenses with Convolutional Neural Networks
- Generative Adversarial Networks recover features in astrophysical images of galaxies beyond the deconvolution limit
- Star-galaxy Classification Using Deep Convolutional Neural Networks
- Learning to Predict the Cosmological Structure Formation
- FastPM: a new scheme for fast simulations of dark matter and halos
- Revisiting the Hubble sequence in the SDSS DR7 spectroscopic sample: a publicly available bayesian automated classification
- Bayesian Neural Networks: An Introduction and Survey
- ANNz2 - photometric redshift and probability distribution function estimation using machine learning
- Photometric Supernova Classification With Machine Learning
- CMU DeepLens: Deep Learning For Automatic Image-based Galaxy-Galaxy Strong Lens Finding
- Photometric redshifts from SDSS images using a Convolutional Neural Network
- SuperNNova: an open-source framework for Bayesian, Neural Network based supernova classification
- Finding Strong Gravitational Lenses in the Kilo Degree Survey with Convolutional Neural Networks
- DeepSphere: Efficient spherical Convolutional Neural Network with HEALPix sampling for cosmological applications
- Photometric redshift estimation via deep learning
- Galaxy Zoo: Probabilistic Morphology through Bayesian CNNs and Active Learning
- Galaxy Types in the Sloan Digital Sky Survey Using Supervised Artificial Neural Networks
- Cosmological constraints with deep learning from KiDS-450 weak lensing maps
- Classifying Radio Galaxies with Convolutional Neural Network
- Using transfer learning to detect galaxy mergers
- Uncertainties in Parameters Estimated with Neural Networks: Application to Strong Gravitational Lensing
- Finding strong lenses in CFHTLS using convolutional neural networks
- A robust morphological classification of high-redshift galaxies using support vector machines on seeing limited images. I Method description
- The weirdest SDSS galaxies: results from an outlier detection algorithm
- Galaxy Morphology Classification with Deep Convolutional Neural Networks
- Non-Gaussian information from weak lensing data via deep learning
- Photometric redshifts with the Multilayer Perceptron Neural Network: application to the HDF-S and SDSS
- Likelihood-free inference with neural compression of DES SV weak lensing map statistics
- Nuisance hardened data compression for fast likelihood-free inference
- Deep learning predictions of galaxy merger stage and the importance of observational realism
- CosmoGAN: creating high-fidelity weak lensing convergence maps using Generative Adversarial Networks
- Deep Recurrent Neural Networks for Supernovae Classification
- Towards optimal extraction of cosmological information from nonlinear data
- Early formation of massive, compact, spheroidal galaxies with classical profiles by violent disc instability or mergers
- Neural computation as a tool for galaxy classification : methods and examples
- Iterative initial condition reconstruction
- Weak lensing cosmology with convolutional neural networks on noisy data
- AI-assisted super-resolution cosmological simulations
- Deblending and Classifying Astronomical Sources with Mask R-CNN Deep Learning
- Robust Machine Learning Applied to Astronomical Datasets I: Star-Galaxy Classification of the SDSS DR3 Using Decision Trees
- Galaxies, Human Eyes and Artificial Neural Networks
- The mass-Peak Patch algorithm for fast generation of deep all-sky dark matter halo catalogues and its N-Body validation
- Modelling the large scale structure of the Universe as a function of cosmology and baryonic physics
- Morpheus: A Deep Learning Framework For Pixel-Level Analysis of Astronomical Image Data
- Fast cosmic web simulations with generative adversarial networks
- SuperRAENN: A Semi-supervised Supernova Photometric Classification Pipeline Trained on Pan-STARRS1 Medium Deep Survey Supernovae
- The Hubble Sequence at in the IllustrisTNG simulation with deep learning
- An automatic taxonomy of galaxy morphology using unsupervised machine learning
- A Deep Learning Approach to Galaxy Cluster X-ray Masses
- Galaxy Merger Rates up to z 3 using a Bayesian Deep Learning Model A Major-Merger classifier using IllustrisTNG Simulation data
- Deep Learning Identifies High-z Galaxies in a Central Blue Nugget Phase in a Characteristic Mass Range
- Identifying Galaxy Mergers in Observations and Simulations with Deep Learning
- Deep learning for galaxy surface brightness profile fitting
- Radio Galaxy Zoo: Compact and extended radio source classification with deep learning
- Deep Convolutional Neural Networks as strong gravitational lens detectors
- Galaxy morphological classification in deep-wide surveys via unsupervised machine learning
- Convolutional neural network identification of galaxy post-mergers in UNIONS using IllustrisTNG
- Identifying Strong Lenses with Unsupervised Machine Learning using Convolutional Autoencoder
- Cosmological constraints from noisy convergence maps through deep learning
- Dimensionality Reduction of SDSS Spectra with Variational Autoencoders
- A Machine Learning Approach for Dynamical Mass Measurements of Galaxy Clusters
- Self-Supervised Representation Learning for Astronomical Images
- Astronomaly: Personalised Active Anomaly Detection in Astronomical Data
- Cosmological Reconstruction From Galaxy Light: Neural Network Based Light-Matter Connection
- Mining for Dark Matter Substructure: Inferring subhalo population properties from strong lenses with machine learning
- Painting with baryons: augmenting N-body simulations with gas using deep generative models
- Wide Field Imaging. I. Applications of Neural Networks to object detection and star/galaxy classification
- Using neural networks to estimate redshift distributions. An application to CFHTLenS
- The quenching of galaxies, bulges, and disks since cosmic noon: A machine learning approach for identifying causality in astronomical data
- A Robust and Efficient Deep Learning Method for Dynamical Mass Measurements of Galaxy Clusters
- Distinguishing standard and modified gravity cosmologies with machine learning
- Deep learning Approach for Classifying, Detecting and Predicting Photometric Redshifts of Quasars in the Sloan Digital Sky Survey Stripe 82
- A comparative study of host galaxy properties between Fast Radio Bursts and stellar transients
- Data-Driven Reconstruction of Gravitationally Lensed Galaxies using Recurrent Inference Machines
- Identification of Low Surface Brightness Tidal Features in Galaxies Using Convolutional Neural Networks
- The relationship between fine galaxy stellar morphology and star formation activity in cosmological simulations: a deep learning view
- Deep learning dark matter map reconstructions from DES SV weak lensing data
- Supernova Photometric Classification Pipelines Trained on Spectroscopically Classified Supernovae from the Pan-STARRS1 Medium-Deep Survey
- Automated Distant Galaxy Merger Classifications from Space Telescope Images using the Illustris Simulation
- Morphological classification of radio galaxies: Capsule Networks versus Convolutional Neural Networks
- Beyond the Hubble Sequence -- Exploring Galaxy Morphology with Unsupervised Machine Learning
- Learning to Denoise Astronomical Images with U-nets
- Photometry of high-redshift blended galaxies using deep learning
- Using Convolutional Neural Networks to identify Gravitational Lenses in Astronomical images
- Anomaly detection in the Zwicky Transient Facility DR3
- Detecting outliers in astronomical images with deep generative networks
- A Machine Learning Based Morphological Classification of 14,245 Radio AGNs Selected From The Best-Heckman Sample
- Photometric Redshifts for the Dark Energy Survey and VISTA and Implications for Large Scale Structure
- Dynamical Mass Measurements of Contaminated Galaxy Clusters Using Machine Learning
- Morphological classification of galaxies with deep learning: comparing 3-way and 4-way CNNs
- Galaxy Morphology Network: A Convolutional Neural Network Used to Study Morphology and Quenching in SDSS and CANDELS Galaxies
- Stellar Masses of Giant Clumps in CANDELS and Simulated Galaxies Using Machine Learning
- Cataloging the radio-sky with unsupervised machine learning: a new approach for the SKA era
- Deblending galaxy superpositions with branched generative adversarial networks
- Galaxy Evolution in all Five CANDELS Fields and IllustrisTNG: Morphological, Structural, and the Major Merger Evolution to
- Deep Generative Models for Galaxy Image Simulations
- A volumetric deep Convolutional Neural Network for simulation of mock dark matter halo catalogues
- CNN Architecture Comparison for Radio Galaxy Classification
- The FIRST Classifier: Compact and Extended Radio Galaxy Classification using Deep Convolutional Neural Networks
- Learning the Relationship between Galaxies Spectra and their Star Formation Histories using Convolutional Neural Networks and Cosmological Simulations
- Translation and Rotation Equivariant Normalizing Flow (TRENF) for Optimal Cosmological Analysis
- Mining the SDSS archive. I. Photometric redshifts in the nearby universe
- A Deep Learning Approach for Active Anomaly Detection of Extragalactic Transients
- Prediction of galaxy halo masses in SDSS DR7 via a machine learning approach
- FlowPM: Distributed TensorFlow Implementation of the FastPM Cosmological N-body Solver
- Deblending galaxies with Variational Autoencoders: a joint multi-band, multi-instrument approach
- AstroVaDEr: Astronomical Variational Deep Embedder for Unsupervised Morphological Classification of Galaxies and Synthetic Image Generation
- Searching for changing-state AGNs in massive datasets -- I: applying deep learning and anomaly detection techniques to find AGNs with anomalous variability behaviours
- Deep Learning for Image Sequence Classification of Astronomical Events
- Interpreting deep learning models for weak lensing
- DeepMerge II: Building Robust Deep Learning Algorithms for Merging Galaxy Identification Across Domains
- Realistic galaxy image simulation via score-based generative models
- The use of convolutional neural networks for modelling large optically-selected strong galaxy-lens samples
- On the dissection of degenerate cosmologies with machine learning
- Fanaroff-Riley classification of radio galaxies using group-equivariant convolutional neural networks
- Forging new worlds: high-resolution synthetic galaxies with chained generative adversarial networks
- An application of machine learning techniques to galaxy cluster mass estimation using the MACSIS simulations
- Horizon-AGN virtual observatory -- 2: Template-free estimates of galaxy properties from colours
- Galaxy cluster mass estimation with deep learning and hydrodynamical simulations
- Deep Learning the Morphology of Dark Matter Substructure
- ERGO-ML I: Inferring the assembly histories of IllustrisTNG galaxies from integral observable properties via invertible neural networks
- HOLISMOKES -- IV. Efficient mass modeling of strong lenses through deep learning
- Denoising Weak Lensing Mass Maps with Deep Learning
- Noise reduction for weak lensing mass mapping: An application of generative adversarial networks to Subaru Hyper Suprime-Cam first-year data
- Dynamical mass inference of galaxy clusters with neural flows
- The PAU Survey: Photometric redshifts using transfer learning from simulations
- ParSNIP: Generative Models of Transient Light Curves with Physics-Enabled Deep Learning
- Probabilistic Mass Mapping with Neural Score Estimation
- Anomaly detection in Hyper Suprime-Cam galaxy images with generative adversarial networks
- Differentiable Strong Lensing: Uniting Gravity and Neural Nets through Differentiable Probabilistic Programming
- MaxiMask and MaxiTrack: two new tools for identifying contaminants in astronomical images using convolutional neural networks
- A gradient based method for modeling baryons and matter in halos of fast simulations
- Quantifying Non-parametric Structure of High-redshift Galaxies with Deep Learning
- Predicting star formation properties of galaxies using deep learning
- Large-Scale Gravitational Lens Modeling with Bayesian Neural Networks for Accurate and Precise Inference of the Hubble Constant
- Baryon acoustic oscillations reconstruction using convolutional neural networks
- Simulation-based inference of dynamical galaxy cluster masses with 3D convolutional neural networks
- Strong lens modelling: comparing and combining Bayesian neural networks and parametric profile fitting
- Morphological classification of compact and extended radio galaxies using convolutional neural networks and data augmentation techniques
- Nonlinear 3D Cosmic Web Simulation with Heavy-Tailed Generative Adversarial Networks
- Approximate Bayesian Uncertainties on Deep Learning Dynamical Mass Estimates of Galaxy Clusters
- Spin Parity of Spiral Galaxies II: A catalogue of 80k spiral galaxies using big data from the Subaru Hyper Suprime-Cam Survey and deep learning
- Generative deep fields: arbitrarily sized, random synthetic astronomical images through deep learning
- Explaining deep learning of galaxy morphology with saliency mapping
- GAlaxy Light profile convolutional neural NETworks (GaLNets). I. fast and accurate structural parameters for billion galaxy samples
- Deep Learning Assisted Data Inspection for Radio Astronomy
- HInet: Generating neutral hydrogen from dark matter with neural networks
- Photometric Classification of 2315 Pan-STARRS1 Supernovae with Superphot
- A method for finding anomalous astronomical light curves and their analogs
- Classifying Image Sequences of Astronomical Transients with Deep Neural Networks
- PSFGAN: a generative adversarial network system for separating quasar point sources and host galaxy light
- Capturing the physics of MaNGA galaxies with self-supervised Machine Learning
- Extracting the main trend in a dataset: the Sequencer algorithm
- Correlating galaxy morphologies and spectra in the 2dFGRS
- Galaxy morphology prediction using capsule networks
- Mapping the Diversity of Galaxy Spectra with Deep Unsupervised Machine Learning
- Preparing to discover the unknown with Rubin LSST -- I: Time domain
- The Hubble Space Telescope WFPC2 B-Band Parallel Survey: A Study of Galaxy Morphology for 18 < B < 27 mag
- The PAU survey: Estimating galaxy photometry with deep learning
- A catalog of broad morphology of Pan-STARRS galaxies based on deep learning
- Auto-identification of unphysical source reconstructions in strong gravitational lens modelling
- The nature of giant clumps in high-z discs: a deep-learning comparison of simulations and observations
- High mass and halo resolution from fast low resolution simulations
- Data--driven Image Restoration with Option--driven Learning for Big and Small Astronomical Image Datasets
- Self-supervised Learning with Physics-aware Neural Networks I: Galaxy Model Fitting
- deepSIP: Linking Type Ia Supernova Spectra to Photometric Quantities with Deep Learning
- Super-resolving Herschel imaging: a proof of concept using Deep Neural Networks
- Quantifying the structure of strong gravitational lens potentials with uncertainty-aware deep neural networks
- Morpho-Photometric Redshifts
- Classifying the formation processes of S0 galaxies using Convolutional Neural Networks
- Toward a Full MHD Jet Model of Spinning Black Holes--II: Kinematics and Application to the M87 Jet
- Exploring galaxy evolution with generative models
- On the cosmological performance of photometrically classified supernovae with machine learning
- The PAU Survey: Background light estimation with deep learning techniques
- A Comparison of Deep Learning Architectures for Optical Galaxy Morphology Classification
- Automatic identification of outliers in Hubble Space Telescope galaxy images
- DeepGalaxy: Deducing the Properties of Galaxy Mergers from Images Using Deep Neural Networks
- Predicting bulge to total luminosity ratio of galaxies using deep learning
Cited by in corpus (47)
- Euclid. I. Overview of the Euclid mission
- Astronomia ex machina: a history, primer, and outlook on neural networks in astronomy
- AstroCLIP: A Cross-Modal Foundation Model for Galaxies
- COSMOS2025: The COSMOS-Web galaxy catalog of photometry, morphology, redshifts, and physical parameters from JWST, HST, and ground-based imaging
- Detection, Instance Segmentation, and Classification for Astronomical Surveys with Deep Learning (DeepDISC): Detectron2 Implementation and Demonstration with Hyper Suprime-Cam Data
- Effective cosmic density field reconstruction with convolutional neural network
- YOLO-CL: Galaxy cluster detection in the SDSS with deep machine learning
- Galaxy merger challenge: A comparison study between machine learning-based detection methods
- YOLO-CIANNA: Galaxy detection with deep learning in radio data. I. A new YOLO-inspired source detection method applied to the SKAO SDC1
- Morphological Classification of Radio Galaxies with wGAN-supported Augmentation
- Optimal, fast, and robust inference of reionization-era cosmology with the 21cmPIE-INN
- Learning the Universe: Cosmological and Astrophysical Parameter Inference with Galaxy Luminosity Functions and Colours
- Ask The Machine: Systematic detection of wind-type outflows in low-mass X-ray binaries
- Uncovering Tidal Treasures: Automated Classification of Faint Tidal Features in DECaLS Data
- Inferring redshift and galaxy properties via a multi-task neural net with probabilistic outputs: An application to simulated MOONS spectra
- The Three Hundred Project: Mapping The Matter Distribution in Galaxy Clusters Via Deep Learning from Multiview Simulated Observations
- Deep learning inference with the Event Horizon Telescope II. The Zingularity framework for Bayesian artificial neural networks
- Beyond Traditional Diagnostics: Identifying Active Galactic Nuclei with Spectral Energy Distribution Fitting in DESI Data
- A post-merger enhancement only in star-forming Type 2 Seyfert galaxies: the deep learning view
- A morphological segmentation approach to determining bar lengths
- Predictive uncertainty on improved astrophysics recovery from multifield cosmology
- Generative modelling for mass-mapping with fast uncertainty quantification
- Learning the Universe: Learning to Optimize Cosmic Initial Conditions with Non-Differentiable Structure Formation Models
- Discovery of the Polar Ring Galaxies with deep learning
- Applying machine learning to Galactic Archaeology: how well can we recover the origin of stars in Milky Way-like galaxies?
- YOLO-CL cluster detection in the Rubin/LSST DC2 simulation
- From VIPERS to SDSS: Unveiling galaxy spectra evolution over 9 Gyr through unsupervised machine-learning
- Bayesian and Convolutional Networks for Hierarchical Morphological Classification of Galaxies
- AGN -- host galaxy photometric decomposition using a fast, accurate and precise deep learning approach
- Uncertainty Quantification of the Virial Black Hole Mass with Conformal Prediction
- Exploring Galaxy Properties of eCALIFA with Contrastive Learning
- Classifying merger stages with adaptive deep learning and cosmological hydrodynamical simulations
- Insights on Galaxy Evolution from Interpretable Sparse Feature Networks
- Datacube segmentation via Deep Spectral Clustering
- Deciphering galaxy images using machine vision -- Combining variational autoencoder and principal component analysis for feature extraction
- J-PAS: A Neural Network Approach to Single Stellar Population Characterization
- Generating Galaxy Clusters Mass Density Maps from Mock Multiview Images via Deep Learning
- Direct reconstruction of the Reionization history from 21cm 2D Power Spectra
- Identifying Anomalous DESI Galaxy Spectra with a Variational Autoencoder
- Very-Long Baseline Interferometry Imaging with Closure Invariants using Conditional Image Diffusion
- Bar Properties and Star-by-Star Bar Membership via Action Conservation
- Measuring the Dark Matter Self-Interaction Cross-Section with Deep Compact Clustering for Robust Machine Learning Inference
- Photometric Redshift Estimation Using Scaled Ensemble Learning
- A gradient boosting and broadband approach to finding Lyman-α emitting galaxies beyond narrowband surveys
- Searching for a signature of turnaround in galaxy clusters with convolutional neural networks
- Neural network emulator to constrain the high- IGM thermal state from Lyman- forest flux auto-correlation function
- Fast Sampling of Cosmological Initial Conditions with Gaussian Neural Posterior Estimation