Interpretability of deep-learning methods applied to large-scale structure surveys
arXiv:2501.18333 · doi:10.1051/0004-6361/202553963
Abstract
Deep learning and convolutional neural networks in particular are powerful and promising tools for cosmological analysis of large-scale structure surveys. They are already providing similar performance to classical analysis methods using fixed summary statistics, are showing potential to break key degeneracies by better probe combination and will likely improve rapidly in the coming years as progress is made in the physical modelling through both software and hardware improvement. One key issue remains: unlike classical analysis, a convolutional neural network's decision process is hidden from the user as the network optimises millions of parameters with no direct physical meaning. This prevents a clear understanding of the potential limitations and biases of the analysis, making it hard to rely on as a main analysis method. In this work, we explore the behaviour of such a convolutional neural network through a novel method. Instead of trying to analyse a network a posteriori, i.e. after training has been completed, we study the impact on the constraining power of training the network and predicting parameters with degraded data where we removed part of the information. This allows us to gain an understanding of which parts and features of a large-scale structure survey are most important in the network's prediction process. We find that the network's prediction process relies on a mix of both Gaussian and non-Gaussian information, and seems to put an emphasis on structures whose scales are at the limit between linear and non-linear regimes.
11 pages, 13 figures, submitted to A&A
References in corpus (36)
- emcee: The MCMC Hammer
- Planck 2013 results. XVI. Cosmological parameters
- A Comprehensive Measurement of the Local Value of the Hubble Constant with 1 km/s/Mpc Uncertainty from the Hubble Space Telescope and the SH0ES Team
- Explaining Deep Neural Networks and Beyond: A Review of Methods and Applications
- Dark Energy Survey Year 3 Results: Cosmological Constraints from Galaxy Clustering and Weak Lensing
- Multi-scale initial conditions for cosmological simulations
- KiDS-1000 Cosmology: Multi-probe weak gravitational lensing and spectroscopic galaxy clustering constraints
- The Atacama Cosmology Telescope: DR4 Maps and Cosmological Parameters
- Intrinsic alignment-lensing interference as a contaminant of cosmic shear
- Dark energy constraints from cosmic shear power spectra: impact of intrinsic alignments on photometric redshift requirements
- Weak Gravitational Lensing by Large-Scale Structure
- Dark Energy Survey Year 3 Results: Cosmology from Cosmic Shear and Robustness to Data Calibration
- The CAMELS project: Cosmology and Astrophysics with MachinE Learning Simulations
- Constraints on intrinsic alignment contamination of weak lensing surveys using the MegaZ-LRG sample
- The Three-Point Correlation Function in Cosmology
- Cosmology with the shear-peak statistics
- Three-Point Correlations in Weak Lensing Surveys: Model Predictions and Applications
- Cosmological constraints with deep learning from KiDS-450 weak lensing maps
- KiDS-Legacy: Cosmological constraints from cosmic shear with the complete Kilo-Degree Survey
- Density split statistics: joint model of counts and lensing in cells
- The Cosmological Impact of Intrinsic Alignment Model Choice for Cosmic Shear
- Feedback reshapes the baryon distribution within haloes, in halo outskirts, and beyond: the closure radius from dwarfs to massive clusters
- Dark Energy Survey Year 3 results: Cosmological constraints from galaxy clustering and galaxy-galaxy lensing using the MagLim lens sample
- A Full CDM Analysis of KiDS-1000 Weak Lensing Maps using Deep Learning
- Interpreting deep learning models for weak lensing
- Cosmological baryon transfer in the SIMBA simulations
- Removing Astrophysics in 21 cm maps with Neural Networks
- Cosmological constraints from HSC survey first-year data using deep learning
- Fast Generation of Covariance Matrices for Weak Lensing
- A roadmap to cosmological parameter analysis with third-order shear statistics I: Modelling and validation
- Neural networks as optimal estimators to marginalize over baryonic effects
- Cosmology from the integrated shear 3-point correlation function: simulated likelihood analyses with machine-learning emulators
- Deep learning insights into cosmological structure formation
- A representation learning approach to probe for dynamical dark energy in matter power spectra
- Enhancing Cosmological Model Selection with Interpretable Machine Learning
- Interpreting Cosmological Information from Neural Networks in the Hydrodynamic Universe