Robustness of Neural Ratio and Posterior Estimators to Distributional Shifts for Population-Level Dark Matter Analysis in Strong Gravitational Lensing
arXiv:2411.05905 · doi:10.3847/1538-4357/adee20 10.3847/1538-4357/adee20
Abstract
We investigate the robustness of Neural Ratio Estimators (NREs) and Neural Posterior Estimators (NPEs) to distributional shifts in the context of measuring the abundance of dark matter subhalos using strong gravitational lensing data. While these data-driven inference frameworks can be accurate on test data from the same distribution as the training sets, in real applications, it is expected that simulated training data and true observational data will differ in their distributions. We explore the behavior of a trained NRE and trained sequential NPEs to estimate the population-level parameters of dark matter subhalos from a large sample of images of strongly lensed galaxies with test data presenting distributional shifts within and beyond the bounds of the training distribution in the nuisance parameters (e.g., the background source morphology). While our results show that NREs and NPEs perform well when tested perfectly in distribution, they exhibit significant biases when confronted with slight deviations from the examples seen in the training distribution. This indicates the necessity for caution when applying NREs and NPEs to real astrophysical data, where high-dimensional underlying distributions are not perfectly known.
arXiv comment20 pages, 7 figures, 4 tables, accepted at ApJ, Volume 989, Issue 2, id.226, 15 pp
References in corpus (50)
- emcee: The MCMC Hammer
- A Universal Density Profile from Hierarchical Clustering
- Nine-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Cosmological Parameter Results
- Particle Dark Matter: Evidence, Candidates and Constraints
- LSST: from Science Drivers to Reference Design and Anticipated Data Products
- The Aquarius Project: the subhalos of galactic halos
- Overview of the DESI Legacy Imaging Surveys
- The Hyper Suprime-Cam SSP Survey: Overview and Survey Design
- Formation of Galaxy Clusters
- Formation and evolution of galaxy dark matter halos and their substructure
- The Sloan Lens ACS Survey. III - The Structure and Formation of Early-type Galaxies and their Evolution since z~1
- Detection of lensing substructure using ALMA observations of the dusty galaxy SDP.81
- Lenstronomy: multi-purpose gravitational lens modelling software package
- Detection of a Dark Substructure through Gravitational Imaging
- ETHOS - An Effective Theory of Structure Formation: From dark particle physics to the matter distribution of the Universe
- Parameterized Machine Learning for High-Energy Physics
- The SL2S Galaxy-scale Lens Sample. IV. The dependence of the total mass density profile of early-type galaxies on redshift, stellar mass, and size
- lenstronomy II: A gravitational lensing software ecosystem
- Constraining Effective Field Theories with Machine Learning
- Source-position transformation -- an approximate invariance in strong gravitational lensing
- The shapes, orientation, and alignment of Galactic dark matter subhalos
- The Sloan Lens ACS Survey. VIII. The relation between environment and internal structure of early-type galaxies
- Lensing substructure quantification in RXJ1131-1231: A 2 keV lower bound on dark matter thermal relic mass
- The Sloan Lens ACS Survey. XIII. Discovery of 40 New Galaxy-Scale Strong Lenses
- The BOSS Emission-Line Lens Survey. IV. : Smooth Lens Models for the BELLS GALLERY Sample
- Measuring the power spectrum of dark matter substructure using strong gravitational lensing
- Size bias and differential lensing of strongly lensed, dusty galaxies identified in wide-field surveys
- Modeling evolution of dark matter substructure and annihilation boost
- The elliptical power law profile lens
- Mining for Dark Matter Substructure: Inferring subhalo population properties from strong lenses with machine learning
- Dark Matter Substructure Detection Using Spatially Resolved Spectroscopy of Lensed Dusty Galaxies
- AstroCLIP: A Cross-Modal Foundation Model for Galaxies
- IllustrisTNG in the HSC-SSP: image data release and the major role of mini mergers as drivers of asymmetry and star formation
- Observational selection biases in time-delay strong lensing and their impact on cosmography
- Hierarchical Inference With Bayesian Neural Networks: An Application to Strong Gravitational Lensing
- The impact of lens galaxy environments on the image separation distribution
- Galaxy density profiles and shapes -- II. selection biases in strong lensing surveys
- On the density profile of dark matter substructure in gravitational lens galaxies
- From Images to Dark Matter: End-To-End Inference of Substructure From Hundreds of Strong Gravitational Lenses
- The Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: A Catalogue of Strong Galaxy-Galaxy Lens Candidates
- SICRET: Supernova Ia Cosmology with truncated marginal neural Ratio EsTimation
- The Intrinsic Scatter of the Radial Acceleration Relation
- The lensing properties of subhaloes in massive elliptical galaxies in sterile neutrino cosmologies
- Strong lensing selection effects
- Quantifying the power spectrum of small-scale structure in semi-analytic galaxies
- One never walks alone: the effect of the perturber population on subhalo measurements in strong gravitational lenses
- Not All Subhaloes Are Created Equal: Modelling the Diversity of Subhalo Density Profiles in TNG50
- Subhalo effective density slope measurements from HST strong lensing data with neural likelihood-ratio estimation
- Inferring subhalo effective density slopes from strong lensing observations with neural likelihood-ratio estimation
- Tackling the Problem of Distributional Shifts: Correcting Misspecified, High-Dimensional Data-Driven Priors for Inverse Problems