Bridging Simulations and Observations: New Insights into Galaxy Formation Simulations via Out-of-Distribution Detection and Bayesian Model Comparison
arXiv:2410.10606 · doi:10.1051/0004-6361/202453399
Abstract
Cosmological simulations are a powerful tool to advance our understanding of galaxy formation and many simulations model key properties of real galaxies. A question that naturally arises for such simulations in light of high-quality observational data is: How close are the models to reality? Due to the high-dimensionality of the problem, many previous studies evaluate galaxy simulations using simplified summary statistics of physical properties. In this work, we combine simulation-based Bayesian model comparison with a novel misspecification detection technique to compare simulated galaxy images of 6 hydrodynamical models observations. Since cosmological simulations are computationally costly, we address the problem of low simulation budgets by first training a -sparse variational autoencoder (VAE) on the abundant dataset of SDSS images. The VAE learns to extract informative latent embeddings and delineates the typical set of real images. To reveal simulation gaps, we then perform out-of-distribution detection (OOD) based on the logits of classifiers trained on the embeddings of simulated images. Finally, we perform amortized Bayesian model comparison using probabilistic classification, identifying the relatively best-performing model along with partial explanations through SHAP values.
accepted to A&A
References in corpus (56)
- XGBoost: A Scalable Tree Boosting System
- SMOTE: Synthetic Minority Over-sampling Technique
- Planck 2013 results. XVI. Cosmological parameters
- Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC
- E pur si muove: Galiliean-invariant cosmological hydrodynamical simulations on a moving mesh
- Introducing the Illustris Project: Simulating the coevolution of dark and visible matter in the Universe
- CANDELS: The Cosmic Assembly Near-infrared Deep Extragalactic Legacy Survey
- CANDELS: The Cosmic Assembly Near-infrared Deep Extragalactic Legacy Survey - The Hubble Space Telescope Observations, Imaging Data Products and Mosaics
- Simulating Galaxy Formation with the IllustrisTNG Model
- First results from the IllustrisTNG simulations: matter and galaxy clustering
- First results from the IllustrisTNG simulations: the stellar mass content of groups and clusters of galaxies
- First results from the IllustrisTNG simulations: the galaxy color bimodality
- Galactic star formation and accretion histories from matching galaxies to dark matter haloes
- UniverseMachine: The Correlation between Galaxy Growth and Dark Matter Halo Assembly from z=0-10
- Radiative transfer in a clumpy universe: IV. New synthesis models of the cosmic UV/X-ray background
- First Results from the TNG50 Simulation: Galactic outflows driven by supernovae and black hole feedback
- First Results from the TNG50 Simulation: The evolution of stellar and gaseous disks across cosmic time
- Dancing in the dark: galactic properties trace spin swings along the cosmic web
- The Relationship Between Stellar Light Distributions of Galaxies and their Formation Histories
- A New Non-Parametric Approach to Galaxy Morphological Classification
- Rotation-invariant convolutional neural networks for galaxy morphology prediction
- Star Formation and Feedback in Smoothed Particle Hydrodynamic Simulations--I. Isolated Galaxies
- The GALAH+ Survey: Third Data Release
- The optical morphologies of galaxies in the IllustrisTNG simulation: a comparison to Pan-STARRS observations
- Making Galaxies in a Cosmological Context: The Need for Early Stellar Feedback
- EMERGE - An empirical model for the formation of galaxies since
- Preparing Red-Green-Blue (RGB) Images from CCD Data
- NIHAO project I: Reproducing the inefficiency of galaxy formation across cosmic time with a large sample of cosmological hydrodynamical simulations
- SKIRT: an Advanced Dust Radiative Transfer Code with a User-Friendly Architecture
- Gasoline2: A Modern SPH Code
- Scaling Relations of Spiral Galaxies
- Galaxy Morphology and Star Formation in the Illustris Simulation at z=0
- A catalogue of 2D photometric decompositions in the SDSS-DR7 spectroscopic main galaxy sample: preferred models and systematics
- On the origin of the chemical bimodality of disk stars: A tale of merger and migration
- NIHAO XV: The environmental impact of the host galaxy on galactic satellite and field dwarf galaxies
- Deep learning predictions of galaxy merger stage and the importance of observational realism
- Galaxies in the Illustris simulation as seen by the Sloan Digital Sky Survey - II: Size-luminosity relations and the deficit of bulge-dominated galaxies in Illustris at low mass
- New Image Statistics for Detecting Disturbed Galaxy Morphologies at High Redshift
- NIHAO XIV: Reproducing the observed diversity of dwarf galaxy rotation curve shapes in LCDM
- NIHAO X: Reconciling the local galaxy velocity function with Cold Dark Matter via mock HI observations
- NIHAO XX: The impact of the star formation threshold on the cusp-core transformation of cold dark matter haloes
- The relationship between fine galaxy stellar morphology and star formation activity in cosmological simulations: a deep learning view
- Beyond the Hubble Sequence -- Exploring Galaxy Morphology with Unsupervised Machine Learning
- NIHAO XII: galactic uniformity in a ΛCDM universe
- Detecting outliers in astronomical images with deep generative networks
- Stars behind bars I: The Milky Way's central stellar populations
- NIHAO -- XXV. Convergence in the cusp-core transformation of cold dark matter haloes at high star formation thresholds
- Introducing galactic structure finder: the multiple stellar kinematic structures of a simulated Milky Way mass galaxy
- NIHAO XXII: Introducing black hole formation, accretion and feedback into the NIHAO simulation suite
- Anomaly detection in Hyper Suprime-Cam galaxy images with generative adversarial networks
- An observational test for star formation prescriptions in cosmological hydrodynamical simulations
- Stars behind bars II: A cosmological formation scenario for the Milky Way's central stellar structure
- A Robust Study of High-Redshift Galaxies: Unsupervised Machine Learning for Characterising morphology with JWST up to z ~ 8
- ERGO-ML: Comparing IllustrisTNG and HSC galaxy images via contrastive learning
- Using Artificial Intelligence and real galaxy images to constrain parameters in galaxy formation simulations
- Quantitatively rating galaxy simulations against real observations with anomaly detection