The Importance of Being Interpretable: Toward An Understandable Machine Learning Encoder for Galaxy Cluster Cosmology
arXiv:2112.05768 · doi:10.3847/1538-4357/ac423e
Abstract
We present a deep machine learning (ML) approach to constraining cosmological parameters with multi-wavelength observations of galaxy clusters. The ML approach has two components: an encoder that builds a compressed representation of each galaxy cluster and a flexible CNN to estimate the cosmological model from a cluster sample. It is trained and tested on simulated cluster catalogs built from the Magneticum simulations. From the simulated catalogs, the ML method estimates the amplitude of matter fluctuations, sigma_8, at approximately the expected theoretical limit. More importantly, the deep ML approach can be interpreted. We lay out three schemes for interpreting the ML technique: a leave-one-out method for assessing cluster importance, an average saliency for evaluating feature importance, and correlations in the terse layer for understanding whether an ML technique can be safely applied to observational data. These interpretation schemes led to the discovery of a previously unknown self-calibration mode for flux- and volume-limited cluster surveys. We describe this new mode, which uses the amplitude and peak of the cluster mass PDF as anchors for mass calibration. We introduce the term "overspecialized" to describe a common pitfall in astronomical applications of machine learning in which the ML method learns simulation-specific details, and we show how a carefully constructed architecture can be used to check for this source of systematic error.
arXiv commentAccepted for publication in The Astrophysical Journal
References in corpus (64)
- Seven-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Cosmological Interpretation
- An overview of gradient descent optimization algorithms
- Towards A Rigorous Science of Interpretable Machine Learning
- Cosmological SPH simulations: A hybrid multi-phase model for star formation
- Modeling feedback from stars and black holes in galaxy mergers
- Toward a halo mass function for precision cosmology: the limits of universality
- Chandra sample of nearby relaxed galaxy clusters: mass, gas fraction, and mass-temperature relation
- Cosmological Parameters from Observations of Galaxy Clusters
- Unmasking Clever Hans Predictors and Assessing What Machines Really Learn
- Chandra Cluster Cosmology Project III: Cosmological Parameter Constraints
- Rotation-invariant convolutional neural networks for galaxy morphology prediction
- Chandra Cluster Cosmology Project II: Samples and X-ray Data Reduction
- The ROSAT-ESO Flux Limited X-ray (REFLEX) Galaxy Cluster Survey. V. The cluster catalogue
- Planck 2013 results. XX. Cosmology from Sunyaev-Zeldovich cluster counts
- Testing X-ray Measurements of Galaxy Clusters with Cosmological Simulations
- A New Robust Low-Scatter X-ray Mass Indicator for Clusters of Galaxies
- COLOSSUS: A python toolkit for cosmology, large-scale structure, and dark matter halos
- The Canadian Cluster Comparison Project: detailed study of systematics and updated weak lensing masses
- A Catalog of 200 Galaxy Clusters Serendipitously Detected in the ROSAT PSPC Pointed Observations
- Virial Scaling of Massive Dark Matter Halos: Why Clusters Prefer a High Normalization Cosmology
- Cluster Cosmology Constraints from the 2500 deg SPT-SZ Survey: Inclusion of Weak Gravitational Lensing Data from Magellan and the Hubble Space Telescope
- The Observed Growth of Massive Galaxy Clusters I: Statistical Methods and Cosmological Constraints
- On the Accuracy of Weak Lensing Cluster Mass Reconstructions
- The Atacama Cosmology Telescope: Sunyaev Zel'dovich Selected Galaxy Clusters at 148 GHz in the 2008 Survey
- Simulating the effect of AGN feedback on the metal enrichment of galaxy clusters
- Galaxy clusters discovered via the Sunyaev-Zel'dovich effect in the first 720 square degrees of the South Pole Telescope survey
- Weighing the Giants - III. Methods and Measurements of Accurate Galaxy Cluster Weak-Lensing Masses
- Connecting Angular Momentum and Galactic Dynamics: The complex Interplay between Spin, Mass, and Morphology
- The Representative XMM-Newton Cluster Structure Survey (REXCESS) of an X-ray Luminosity Selected Galaxy Cluster Sample
- Halo mass function: Baryon impact, fitting formulae and implications for cluster cosmology
- Self Calibration in Cluster Studies of Dark Energy: Combining the Cluster Redshift Distribution, the Power Spectrum and Mass Measurements
- SZ effects in the Magneticum Pathfinder Simulation: Comparison with the Planck, SPT, and ACT results
- An MHD Gadget for cosmological simulations
- Gas Clumping in the Outskirts of Lambda-CDM Clusters
- The Lx-Yx Relation: Using Galaxy Cluster X-Ray Luminosity as a Robust, Low Scatter Mass Proxy
- X-ray Properties of SPT Selected Galaxy Clusters at 0.2<z<1.5 Observed with XMM-Newton
- Investigating the velocity structure and X-ray observable properties of simulated galaxy clusters with PHOX
- The influence of the environmental history on quenching star formation in a CDM universe
- Future Galaxy Cluster Surveys: The Effect of Theory Uncertainty on Constraining Cosmological Parameters
- Self-Consistency and Calibration of Cluster Number Count Surveys for Dark Energy
- HeCS-SZ: The Hectospec Survey of Sunyaev-Zeldovich Selected Clusters
- SuperRAENN: A Semi-supervised Supernova Photometric Classification Pipeline Trained on Pan-STARRS1 Medium Deep Survey Supernovae
- A Deep Learning Approach to Galaxy Cluster X-ray Masses
- A Machine Learning Approach for Dynamical Mass Measurements of Galaxy Clusters
- A Model for Multi-property Galaxy Cluster Statistics
- On the linearity of tracer bias around voids
- A Robust and Efficient Deep Learning Method for Dynamical Mass Measurements of Galaxy Clusters
- Localized massive halo properties in Bahamas and Macsis simulations: scalings, log-normality, and covariance
- Observing simulated galaxy clusters with PHOX: a novel X-ray photon simulator
- The Outer Halos of Very Massive Galaxies: BCGs and their DSC in the Magneticum Simulations
- Dynamical Mass Measurements of Contaminated Galaxy Clusters Using Machine Learning
- Interpreting deep learning models for weak lensing
- Stellar Property Statistics of Massive Halos from Cosmological Hydrodynamics Simulations: Common Kernel Shapes
- The Atacama Cosmology Telescope: A Measurement of the Thermal Sunyaev-Zel'dovich Effect Using the Skewness of the CMB Temperature Distribution
- Removing Astrophysics in 21 cm maps with Neural Networks
- Using X-Ray Morphological Parameters to Strengthen Galaxy Cluster Mass Estimates via Machine Learning
- Do Androids Dream of Magnetic Fields? Using Neural Networks to Interpret the Turbulent Interstellar Medium
- Multiwavelength cluster mass estimates and machine learning
- Cosmology with velocity dispersion counts: an alternative to measuring cluster halo masses
- The XXL Survey: XXIII. The Mass Scale of XXL Clusters from Ensemble Spectroscopy
- The cosmological analysis of X-ray cluster surveys; III. 4D X-ray observable diagrams
- Applying saliency-map analysis in searches for pulsars and fast radio bursts
- The Velocity Distribution Function of Galaxy Clusters as a Cosmological Probe
- Cluster Cosmology with the Velocity Distribution Function of the HeCS-SZ Sample
Cited by in corpus (5)
- Augmenting astrophysical scaling relations with machine learning: application to reducing the Sunyaev-Zeldovich flux-mass scatter
- KLLR: A scale-dependent, multivariate model class for regression analysis
- Benchmarks and Explanations for Deep Learning Estimates of X-ray Galaxy Cluster Masses
- Rapid Spectral Parameter Prediction for Black Hole X-Ray Binaries using Physicalised Autoencoders
- Towards an optimal extraction of cosmological parameters from galaxy cluster surveys using convolutional neural networks