Deep learning predictions of galaxy merger stage and the importance of observational realism
arXiv:1910.07031 · doi:10.1093/mnras/stz2934
Abstract
Machine learning is becoming a popular tool to quantify galaxy morphologies and identify mergers. However, this technique relies on using an appropriate set of training data to be successful. By combining hydrodynamical simulations, synthetic observations and convolutional neural networks (CNNs), we quantitatively assess how realistic simulated galaxy images must be in order to reliably classify mergers. Specifically, we compare the performance of CNNs trained with two types of galaxy images, stellar maps and dust-inclusive radiatively transferred images, each with three levels of observational realism: (1) no observational effects (idealized images), (2) realistic sky and point spread function (semi-realistic images), (3) insertion into a real sky image (fully realistic images). We find that networks trained on either idealized or semi-real images have poor performance when applied to survey-realistic images. In contrast, networks trained on fully realistic images achieve 87.1% classification performance. Importantly, the level of realism in the training images is much more important than whether the images included radiative transfer, or simply used the stellar maps (87.1% compared to 79.6% accuracy, respectively). Therefore, one can avoid the large computational and storage cost of running radiative transfer with a relatively modest compromise in classification performance. Making photometry-based networks insensitive to colour incurs a very mild penalty to performance with survey-realistic data (86.0% with r-only compared to 87.1% with gri). This result demonstrates that while colour can be exploited by colour-sensitive networks, it is not necessary to achieve high accuracy and so can be avoided if desired. We provide the public release of our statistical observational realism suite, RealSim, as a companion to this paper.
arXiv commentMNRAS accepted. 25 pages, 15 figures, 4 tables. RealSim: https://github.com/cbottrell/RealSim
References in corpus (118)
- On the variation of the Initial Mass Function
- The Seventh Data Release of the Sloan Digital Sky Survey
- Deep Residual Learning for Image Recognition
- Starburst99: Synthesis Models for Galaxies with Active Star Formation
- Multi-messenger Observations of a Binary Neutron Star Merger
- The EAGLE project: Simulating the evolution and assembly of galaxies and their environments
- Energy input from quasars regulates the growth and activity of black holes and their host galaxies
- A systematic study of the class imbalance problem in convolutional neural networks
- Modeling feedback from stars and black holes in galaxy mergers
- The Formation of Galactic Disks
- First results from the IllustrisTNG simulations: the stellar mass content of groups and clusters of galaxies
- Overview of the SDSS-IV MaNGA Survey: Mapping Nearby Galaxies at Apache Point Observatory
- Gasdynamics and Starbursts in Major Mergers
- A Cosmological Framework for the Co-Evolution of Quasars, Supermassive Black Holes, and Elliptical Galaxies: I. Galaxy Mergers & Quasar Activity
- First results from the IllustrisTNG simulations: the galaxy color bimodality
- The Ninth Data Release of the Sloan Digital Sky Survey: First Spectroscopic Data from the SDSS-III Baryon Oscillation Spectroscopic Survey
- Galactic star formation and accretion histories from matching galaxies to dark matter haloes
- GIZMO: A New Class of Accurate, Mesh-Free Hydrodynamic Simulation Methods
- FIRE-2 Simulations: Physics versus Numerics in Galaxy Formation
- The Relationship Between Stellar Light Distributions of Galaxies and their Formation Histories
- A New Non-Parametric Approach to Galaxy Morphological Classification
- Rotation-invariant convolutional neural networks for galaxy morphology prediction
- The merger rate of galaxies in the Illustris Simulation: a comparison with observations and semi-empirical models
- A New Calculation of the Ionizing Background Spectrum and the Effects of HeII Reionization
- New Interstellar Dust Models Consistent with Extinction, Emission, and Abundance Constraints
- Mapping Large-Scale Gaseous Outflows in Ultraluminous Galaxies with Keck II ESI Spectra: Variations in Outflow Velocity with Galactic Mass
- A Catalog of Bulge+Disk Decompositions and Updated Photometry for 1.12 Million Galaxies in the Sloan Digital Sky Survey
- Outflows in Infrared-Luminous Starbursts at z < 0.5. II. Analysis and Discussion
- Galaxy Pairs in the Sloan Digital Sky Survey I: Star Formation, AGN Fraction, and the Luminosity/Mass-Metallicity Relation
- A Merger-Driven Scenario for Cosmological Disk Galaxy Formation
- How Do Massive Black Holes Get Their Gas?
- The effect of galaxy mass ratio on merger--driven starbursts
- A Catalog of Detailed Visual Morphological Classifications for 14034 Galaxies in the Sloan Digital Sky Survey
- The optical morphologies of galaxies in the IllustrisTNG simulation: a comparison to Pan-STARRS observations
- A New Approach to Galaxy Morphology: I. Analysis of the Sloan Digital Sky Survey Early Data Release
- Statistical Properties of Collisionless Equal- and Unequal-Mass Merger Remnants of Disk Galaxies
- The Major and Minor Galaxy Merger Rates at z < 1.5
- Galaxy Merger Morphologies and Time-Scales from Simulations of Equal-Mass Gas-Rich Disc Mergers
- A Cosmological Framework for the Co-Evolution of Quasars, Supermassive Black Holes, and Elliptical Galaxies: II. Formation of Red Ellipticals
- Fast Molecular Outflows in Luminous Galaxy Mergers: Evidence for Quasar Feedback from Herschel
- Galaxy pairs in the Sloan Digital Sky Survey - IV: Interactions trigger AGN
- Supernova feedback efficiency and mass loading in the starburst and galactic superwind exemplar M82
- Improving galaxy morphologies for SDSS with Deep Learning
- Structural and Photometric Classification of Galaxies - I. Calibration Based on a Nearby Galaxy Sample
- Tidally-Triggered Star Formation in Close Pairs of Galaxies
- Photometric Response Functions of the SDSS Imager
- Efficient 3D NLTE dust radiative transfer with SKIRT
- SKIRT: an Advanced Dust Radiative Transfer Code with a User-Friendly Architecture
- Star Formation in Galaxy Mergers with Realistic Models of Stellar Feedback & the Interstellar Medium
- Sunrise: Polychromatic Dust Radiative Transfer in Arbitrary Geometries
- A catalog of visual-like morphologies in the 5 CANDELS fields using deep-learning
- The Deep2 Galaxy Redshift Survey: Evolution of Close Galaxy Pairs and Major-Merger Rates Up to z ~ 1.2
- Molecular and atomic gas along and across the main sequence of star-forming galaxies
- Fast Automated Analysis of Strong Gravitational Lenses with Convolutional Neural Networks
- Galaxy pairs in the Sloan Digital Sky Survey - IX: Merger-induced AGN activity as traced by the Wide-field Infrared Survey Explorer
- Modelling the Pan-Spectral Energy Distribution of Starburst Galaxies: IV The Controlling Parameters of the Starburst SED
- Outflows in AGN/Starburst-Composite Ultraluminous Infrared Galaxies
- The Effect of Mass Ratio on the Morphology and Time-scales of Disc Galaxy Mergers
- A catalog of bulge, disk, and total stellar mass estimates for the Sloan Digital Sky Survey
- Galaxy pairs in the Sloan Digital Sky Survey - VI. The orbital extent of enhanced star formation in interacting galaxies
- Dynamically Close Galaxy Pairs and Merger Rate Evolution in the CNOC2 Redshift Survey
- Galaxy Mergers and the Mass-Metallicity Relation: Evidence for Nuclear Metal Dilution and Flattened Gradients from Numerical Simulations
- How stellar feedback simultaneously regulates star formation and drives outflows
- Metallicity and Nuclear Star Formation in Nearby Galaxy Pairs: Evidence for Tidally Induced Gas Flows
- The Metallicity Evolution of Interacting Galaxies
- Gas-Phase Oxygen Gradients in Strongly Interacting Galaxies: I. Early-Stage Interactions
- Galaxy Zoo: the fraction of merging galaxies in the SDSS and their morphologies
- Galaxy Interactions Trigger Rapid Black Hole Growth: an unprecedented view from the Hyper Suprime-Cam Survey
- A definitive merger-AGN connection at z~0 with CFIS: mergers have an excess of AGN and AGN hosts are more frequently disturbed
- Merging and Clustering of the Swift BAT AGN Sample
- The Effect of Gas Fraction on the Morphology and Time-scales of Disc Galaxy Mergers
- The structures and total (minor + major) merger histories of massive galaxies up to z = 3 in the HST GOODS NICMOS Survey: A possible solution to the size evolution problem
- Galaxy Pairs in the Sloan Digital Sky Survey - III: Evidence of Induced Star Formation from Optical Colours
- Galaxy And Mass Assembly (GAMA): Galaxy close-pairs, mergers, and the future fate of stellar mass
- Mapping galaxy encounters in numerical simulations: The spatial extent of induced star formation
- On the possible environmental effect in distributing heavy elements beyond individual gaseous halos
- Shape asymmetry: a morphological indicator for automatic detection of galaxies in the post-coalescence merger stages
- Dissipation and Extra Light in Galactic Nuclei: I. Gas-Rich Merger Remnants
- CANDELS Visual Classifications: Scheme, Data Release, and First Results
- The Luminosity Dependence of the Galaxy Merger Rate
- Interacting galaxies on FIRE-2: The connection between enhanced star formation and interstellar gas content
- The Spitzer Spirals, Bridges, and Tails Interacting Galaxy Survey: Interaction-Induced Star Formation in the Mid-Infrared
- Using transfer learning to detect galaxy mergers
- The role of mergers in driving morphological transformation over cosmic time
- AEGIS: Enhancement of Dust-enshrouded Star Formation in Close Galaxy Pairs and Merging Galaxies up to z ~ 1
- A Survey of Faint Galaxy Pairs
- Galaxy Zoo: Quantitative Visual Morphological Classifications for 48,000 galaxies from CANDELS
- Zooming in on major mergers: dense, starbursting gas in cosmological simulations
- Chemical evolution during gas-rich galaxy interactions
- Galaxy And Mass Assembly (GAMA): Refining the Local Galaxy Merger Rate using Morphological Information
- Finding high-redshift strong lenses in DES using convolutional neural networks
- Spatially resolved star formation and metallicity profiles in post-merger galaxies from MaNGA
- Galaxy pairs in the Sloan Digital Sky Survey - XI. A new method for measuring the influence of the closest companion out to wide separations
- Galaxies in the Illustris simulation as seen by the Sloan Digital Sky Survey - II: Size-luminosity relations and the deficit of bulge-dominated galaxies in Illustris at low mass
- The Hubble Sequence at in the IllustrisTNG simulation with deep learning
- Transfer learning for galaxy morphology from one survey to another
- A Deep Learning Approach to Galaxy Cluster X-ray Masses
- Go with the Flow: Understanding Inflow Mechanisms in Galaxy Collisions
- Identifying Galaxy Mergers in Observations and Simulations with Deep Learning
- On the lifetime of merger features of equal-mass disk mergers
- Delayed or no feedback? - Gas outflows in Type 2 AGNs. III
- The VIMOS VLT Deep Survey: the contribution of minor mergers to the growth of L_B >= L*_B galaxies since z ~ 1 from spectroscopically identified pairs
- Galaxy Zoo: Quantifying Morphological Indicators of Galaxy Interaction
- What shapes a galaxy? - Unraveling the role of mass, environment and star formation in forming galactic structure
- Galaxy pairs in the Sloan Digital Sky Survey - XII: The fuelling mechanism of low excitation radio-loud AGN
- Identification of Low Surface Brightness Tidal Features in Galaxies Using Convolutional Neural Networks
- Automated Distant Galaxy Merger Classifications from Space Telescope Images using the Illustris Simulation
- Galaxy mergers moulding the circum-galactic medium - I. The impact of a major merger
- Accurate Identification of Galaxy Mergers with Imaging
- An instability of feedback regulated star formation in galactic nuclei
- Bulge plus disc and Sérsic decomposition catalogues for 16,908 galaxies in the SDSS Stripe 82 co-adds: A detailed study of the structural measurements
- PRIMUS: Enhanced Specific Star Formation Rates In Close Galaxy Pairs
- Galaxies in the Illustris simulation as seen by the Sloan Digital Sky Survey - I: Bulge+disc decompositions, methods, and biases
- The Molecular Wind in the Nearest Seyfert Galaxy Circinus Revealed by ALMA
- The signature of dissipation in the mass-size relation: are bulges simply spheroids wrapped in a disc?
- A New Public Release of the GIZMO Code
- Artificial neural network based calibrations for the prediction of galactic [NII] 6584 and H line luminosities
- The VIMOS VLT Deep Survey. The different assembly history of passive and star-forming L_B >= L*_B galaxies in the group environment at z < 1
Cited by in corpus (77)
- The DAWES review 10: The impact of deep learning for the analysis of galaxy surveys
- Galaxy Merger Rates up to z 3 using a Bayesian Deep Learning Model A Major-Merger classifier using IllustrisTNG Simulation data
- Convolutional neural network identification of galaxy post-mergers in UNIONS using IllustrisTNG
- Galaxy mergers in EAGLE do not induce a significant amount of black hole growth yet do increase the rate of luminous AGN
- Galaxy mergers can rapidly shut down star formation
- The relationship between fine galaxy stellar morphology and star formation activity in cosmological simulations: a deep learning view
- Galaxy Morphological Classification Catalogue of the Dark Energy Survey Year 3 data with Convolutional Neural Networks
- IllustrisTNG in the HSC-SSP: image data release and the major role of mini mergers as drivers of asymmetry and star formation
- The merger fraction of post-starburst galaxies in UNIONS
- Characterization of Low Surface Brightness structures in annotated deep images
- DeepMerge II: Building Robust Deep Learning Algorithms for Merging Galaxy Identification Across Domains
- ERGO-ML I: Inferring the assembly histories of IllustrisTNG galaxies from integral observable properties via invertible neural networks
- Star formation characteristics of CNN-identified post-mergers in the Ultraviolet Near Infrared Optical Northern Survey (UNIONS)
- Morphological signatures of mergers in the TNG50 simulation and the Kilo-Degree Survey: the merger fraction from dwarfs to Milky Way-like galaxies
- Galaxy pairs in the Sloan Digital Sky Survey -- XIV. Galaxy mergers do not lie on the Fundamental Metallicity Relation
- Galaxy interactions in IllustrisTNG-100, I: The power and limitations of visual identification
- Galaxy sizes and the galaxy-halo connection -- I: the remarkable tightness of the size distributions
- A significant excess in major merger rate for AGNs with the highest Eddington ratios at z<0.2
- The combined and respective roles of imaging and stellar kinematics in identifying galaxy merger remnants
- North Ecliptic Pole merging galaxy catalogue
- Identifying Galaxy Mergers in Simulated CEERS NIRCam Images using Random Forests
- Towards a consistent framework of comparing galaxy mergers in observations and simulations
- Identification of tidal features in deep optical galaxy images with Convolutional Neural Networks
- A Method to Distinguish Quiescent and Dusty Star-forming Galaxies with Machine Learning
- AGN in post-mergers from the Ultraviolet Near Infrared Optical Northern Survey
- Stellar Populations With Optical Spectra: Deep Learning vs. Popular Spectrum Fitting Codes
- An IFU View of the Active Galactic Nuclei in MaNGA Galaxy Pairs
- Towards robust determination of non-parametric morphologies in marginal astronomical data: resolving uncertainties with cosmological hydrodynamical simulations
- Accurate Identification of Galaxy Mergers with Stellar Kinematics
- A re-assessment of strong line metallicity conversions in the machine learning era
- The observability of galaxy merger signatures in nearby gas-rich spirals
- A complete catalogue of merger fractions in AGN hosts: No evidence for an increase in detected merger fraction with AGN luminosity
- The galaxy morphology-density relation in the EAGLE simulation
- Mapping the Diversity of Galaxy Spectra with Deep Unsupervised Machine Learning
- Dust and Power: Unravelling the merger - active galactic nucleus connection in the second half of cosmic history
- The Connection between Mergers and AGN Activity in Simulated and Observed Massive Galaxies
- Realistic synthetic integral field spectroscopy with RealSim-IFS
- Galaxy And Mass Assembly (GAMA): Comparing Visually and Spectroscopically Identified Galaxy Merger Samples
- The nature of giant clumps in high-z discs: a deep-learning comparison of simulations and observations
- Galaxy merger challenge: A comparison study between machine learning-based detection methods
- Molecular gas and star formation in nearby starburst galaxy mergers
- Comparison of Multi-Class and Binary Classification Machine Learning Models in Identifying Strong Gravitational Lenses
- ERGO-ML: Towards a robust machine learning model for inferring the fraction of accreted stars in galaxies from integral-field spectroscopic maps
- ERGO-ML: Comparing IllustrisTNG and HSC galaxy images via contrastive learning
- A 3.8yr optical quasi-periodic oscillations in blue quasar SDSS J132144+033055 through combined light curves from CSS and ZTF
- Gaussian Process Classification for Galaxy Blend Identification in LSST
- Lessons Learned from the Two Largest Galaxy Morphological Classification Catalogues built by Convolutional Neural Networks
- Identification of Grand-design and Flocculent Spirals from SDSS using Convolutional Neural network
- Machine learning the gap between real and simulated nebulae: A domain-adaptation approach to classify ionised nebulae in nearby galaxies
- Automated Detection of Double Nuclei Galaxies using GOTHIC and the Discovery of a Large Sample of Dual AGN
- Mock Galaxy Surveys for HST and JWST from the IllustrisTNG Simulations
- Cosmology with Galaxy Cluster Properties using Machine Learning
- An astronomical image content-based recommendation system using combined deep learning models in a fully unsupervised mode
- A candidate of binary black hole system in AGN with broad Balmer emission lines having quite different line widths
- Merger identification through photometric bands, colours, and their errors
- Machine learning technique for morphological classification of galaxies from SDSS. II. The image-based morphological catalogs of galaxies at 0.02<z<0.1
- Machine learning technique for morphological classification of galaxies from the SDSS. III. Image-based inference of detailed features
- SDSS-IV MaNGA: Unveiling Galaxy Interaction by Merger Stages with Machine Learning
- Harnessing the Hubble Space Telescope Archives: A Catalogue of 21,926 Interacting Galaxies
- Halo Growth and Merger Rates as a Cosmological Test
- Determining the time before or after a galaxy merger event
- Total and dark mass from observations of galaxy centers with Machine Learning
- A post-merger enhancement only in star-forming Type 2 Seyfert galaxies: the deep learning view
- Galaxy pairs in The Three Hundred simulations II: studying bound ones and identifying them via machine learning
- IllustrisTNG in the HSC-SSP: No Shortage of Thin Disk Galaxies in TNG50
- GalaxyGenius: Mock galaxy image generator for various telescopes from hydrodynamical simulations
- AGN -- host galaxy photometric decomposition using a fast, accurate and precise deep learning approach
- Harvesting the Lyα forest with convolutional neural networks
- Quantitatively rating galaxy simulations against real observations with anomaly detection
- Classifying merger stages with adaptive deep learning and cosmological hydrodynamical simulations
- A machine learning approach to assessing the presence of substructure in quasar host galaxies using the Hyper Suprime-Cam Subaru Strategic Program
- DeepMerge: Classifying High-redshift Merging Galaxies with Deep Neural Networks
- Bridging Simulations and Observations: New Insights into Galaxy Formation Simulations via Out-of-Distribution Detection and Bayesian Model Comparison
- The Next Generation Virgo Cluster Survey (NGVS). XL. The Morphological Classification of Virgo Cluster Galaxies
- The major merger-active galactic nucleus connection up to the cosmic noon
- A Simulation Driven Deep Learning Approach for Separating Mergers and Star Forming Galaxies: The Formation Histories of Clumpy Galaxies in all the CANDELS Fields
- Merger fraction in galaxy groups and clusters at z < 0.2: A non-parametric morphological study with Subaru Hyper Suprime-Cam