Mining for Dark Matter Substructure: Inferring subhalo population properties from strong lenses with machine learning

Abstract

The subtle and unique imprint of dark matter substructure on extended arcs in strong lensing systems contains a wealth of information about the properties and distribution of dark matter on small scales and, consequently, about the underlying particle physics. However, teasing out this effect poses a significant challenge since the likelihood function for realistic simulations of population-level parameters is intractable. We apply recently-developed simulation-based inference techniques to the problem of substructure inference in galaxy-galaxy strong lenses. By leveraging additional information extracted from the simulator, neural networks are efficiently trained to estimate likelihood ratios associated with population-level parameters characterizing substructure. Through proof-of-principle application to simulated data, we show that these methods can provide an efficient and principled way to simultaneously analyze an ensemble of strong lenses, and can be used to mine the large sample of lensing images deliverable by near-future surveys for signatures of dark matter substructure.

23 pages, 6 figures, code available at https://github.com/smsharma/mining-for-substructure-lens; v2, minor changes to text, version accepted in ApJ

References in corpus (145)

• Astropy: A Community Python Package for Astronomy
• The NumPy array: a structure for efficient numerical computation
• Planck 2015 results. XIII. Cosmological parameters
• A Universal Density Profile from Hierarchical Clustering
• The Structure of Cold Dark Matter Halos
• The Astropy Project: Building an inclusive, open-science project and status of the v2.0 core package
• Binary companions of evolved stars in APOGEE DR14: Search method and catalog of ~5,000 companions
• WaveNet: A Generative Model for Raw Audio
• Asymptotic formulae for likelihood-based tests of new physics
• Weak Gravitational Lensing
• Observational evidence for self-interacting cold dark matter
• Conditional Image Generation with PixelCNN Decoders
• Large Magellanic Cloud Cepheid Standards Provide a 1% Foundation for the Determination of the Hubble Constant and Stronger Evidence for Physics Beyond LambdaCDM
• The Aquarius Project: the subhalos of galactic halos
• Dark Matter Search Results from a One Tonne$\times$Year Exposure of XENON1T
• Results from a search for dark matter in the complete LUX exposure
• Pixel Recurrent Neural Networks
• NICE: Non-linear Independent Components Estimation
• H0LiCOW XIII. A 2.4% measurement of $H_0$ from lensed quasars: $5.3\sigma$ tension between early and late-Universe probes
• Halo Formation in Warm Dark Matter Models
• The Dark Energy Survey: more than dark energy - an overview
• LSST Science Book, Version 2.0
• Dark Matter Results From 54-Ton-Day Exposure of PandaX-II Experiment
• The Connection between Galaxies and their Dark Matter Halos
• Density estimation using Real NVP
• Direct Detection of CDM Substructure
• Eight New Milky Way Companions Discovered in First-Year Dark Energy Survey Data
• Subhaloes in Self-Interacting Galactic Dark Matter Haloes
• Dark Matter Halos as Particle Colliders: A Unified Solution to Small-Scale Structure Puzzles from Dwarfs to Clusters
• Neural Ordinary Differential Equations
• Beasts of the Southern Wild: Discovery of nine Ultra Faint satellites in the vicinity of the Magellanic Clouds
• Eight Ultra-faint Galaxy Candidates Discovered in Year Two of the Dark Energy Survey
• Cosmological Simulations with Self-Interacting Dark Matter II: Halo Shapes vs. Observations
• Searching for Dark Matter Annihilation in Recently Discovered Milky Way Satellites with Fermi-LAT
• The properties of warm dark matter haloes
• Strong Lensing by Galaxies
• Constraining Self-Interacting Dark Matter with the Milky Way's dwarf spheroidals
• Gravitationally lensed quasars and supernovae in future wide-field optical imaging surveys
• Halo Properties in Cosmological Simulations of Self-Interacting Cold Dark Matter
• Gravitational detection of a low-mass dark satellite at cosmological distance
• The Luminosity Function of the Milky Way Satellites
• The population of galaxy-galaxy strong lenses in forthcoming optical imaging surveys
• Not so lumpy after all: modeling the depletion of dark matter subhalos by Milky Way-like galaxies
• MADE: Masked Autoencoder for Distribution Estimation
• Detection of lensing substructure using ALMA observations of the dusty galaxy SDP.81
• Lenstronomy: multi-purpose gravitational lens modelling software package
• Detection of a Dark Substructure through Gravitational Imaging
• Nonlinear Evolution of Cosmological Structures in Warm Dark Matter Models
• Weakly Self-Interacting Dark Matter and the Structure of Dark Halos
• Shear and Ellipticity in Gravitational Lenses
• Double-Disk Dark Matter
• How the Self-Interacting Dark Matter Model Explains the Diverse Galactic Rotation Curves
• Fast Automated Analysis of Strong Gravitational Lenses with Convolutional Neural Networks
• ETHOS - An Effective Theory of Structure Formation: Dark matter physics as a possible explanation of the small-scale CDM problems
• A Bayesian analysis of regularised source inversions in gravitational lensing
• A SHARP view of H0LiCOW: $H_0$ from three time-delay gravitational lens systems with adaptive optics imaging
• FIRE in the Field: Simulating the Threshold of Galaxy Formation
• Semi-linear gravitational lens inversion
• Parameterized Machine Learning for High-Energy Physics
• The flattening of the concentration-mass relation towards low halo masses and its implications for the annihilation signal boost
• Fast likelihood-free cosmology with neural density estimators and active learning
• The stellar mass-halo mass relation of isolated field dwarfs: a critical test of $\Lambda$CDM at the edge of galaxy formation
• Tidal Streams as Probes of the Galactic Potential
• Masked Autoregressive Flow for Density Estimation
• The Spur and the Gap in GD-1: Dynamical evidence for a dark substructure in the Milky Way halo
• Halo Cores and Phase Space Densities: Observational Constraints on Dark Matter Physics and Structure Formation
• Dark matter subhalos and the dwarf satellites of the Milky Way
• Characterization of subhalo structural properties and implications for dark matter annihilation signals
• Analytic models of plausible gravitational lens potentials
• Tying Dark Matter to Baryons with Self-interactions
• Mining gold from implicit models to improve likelihood-free inference
• Constraining Effective Field Theories with Machine Learning
• Gravitational probes of dark matter physics
• Gravitational lens modeling with basis sets
• Dark Matter Sub-Halo Counts via Star Stream Crossings
• A Guide to Constraining Effective Field Theories with Machine Learning
• Search for dijet resonances in proton-proton collisions at sqrt(s) = 13 TeV and constraints on dark matter and other models
• Detection of substructure with adaptive optics integral field spectroscopy of the gravitational lens B1422+231
• Uncertainties in Parameters Estimated with Neural Networks: Application to Strong Gravitational Lensing
• A unified model for the spatial and mass distribution of subhaloes
• Structure and Subhalo Population of Halos in a Self-Interacting Dark Matter Cosmology
• Approximating Likelihood Ratios with Calibrated Discriminative Classifiers
• Probing dark matter structure down to $10^7$ solar masses: flux ratio statistics in gravitational lenses with line of sight halos
• FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Models
• AutoLens: Automated Modeling of a Strong Lens's Light, Mass and Source
• Modelling the line-of-sight contribution in substructure lensing
• Nuisance hardened data compression for fast likelihood-free inference
• Accelerated core collapse in tidally stripped self-interacting dark matter halos
• Scattering, Damping, and Acoustic Oscillations: Simulating the Structure of Dark Matter Halos with Relativistic Force Carriers
• Lensing substructure quantification in RXJ1131-1231: A 2 keV lower bound on dark matter thermal relic mass
• A Testable Conspiracy: Simulating Baryonic Effects on Self-Interacting Dark Matter Halos
• Euclid Imaging Consortium Science Book
• The impact of baryonic physics on the subhalo mass function and implications for gravitational lensing
• Probing dark matter substructure in the gravitational lens HE0435-1223 with the WFC3 grism
• Generalized massive optimal data compression
• Measuring the power spectrum of dark matter substructure using strong gravitational lensing
• Flexible statistical inference for mechanistic models of neural dynamics
• The information content in cold stellar streams
• Dark matter-radiation interactions: the impact on dark matter haloes
• Constraints on the identity of the dark matter from strong gravitational lenses
• Constraints on mediator-based dark matter and scalar dark energy models using $\sqrt{s}=13$ TeV $pp$ collision data collected by the ATLAS detector
• Modeling evolution of dark matter substructure and annihilation boost
• Evaporating the Milky Way halo and its satellites with inelastic self-interacting dark matter
• Gaps in the GD-1 Star Stream
• Halometry from Astrometry
• Dwarf Galaxies in CDM, WDM, and SIDM: Disentangling Baryons and Dark Matter Physics
• Modeling the Connection Between Subhalos and Satellites in Milky Way-like Systems
• Likelihood-free inference with emulator networks
• Quantifying dwarf satellites through gravitational imaging: the case of SDSS J120602.09+514229.5
• Sequential Neural Likelihood: Fast Likelihood-free Inference with Autoregressive Flows
• Substructure in the lens HE 0435-1223
• Data-Driven Reconstruction of Gravitationally Lensed Galaxies using Recurrent Inference Machines
• The effect of a disc on the population of cuspy and cored dark matter substructures in Milky Way-like galaxies
• The Milky Way's Halo and Subhalos in Self-Interacting Dark Matter
• Probing the nature of dark matter by forward modeling flux ratios in strong gravitational lenses
• A Search for Dark Matter Annihilation in Galaxy Groups
• Collapsed Dark Matter Structures
• A Catalog of Mass Models for Gravitational Lensing
• Small scale aspects of warm dark matter : power spectra and acoustic oscillations
• Line-of-sight effects in strong lensing: Putting theory into practice
• Inference Networks for Sequential Monte Carlo in Graphical Models
• Dark Catalysis
• On the Power Spectrum of Dark Matter Substructure in Strong Gravitational Lenses
• Gravitational Lensing and the Power Spectrum of Dark Matter Substructure: Insights from the ETHOS N-body Simulations
• A Search for Dark Matter Annihilation in the Milky Way Halo
• A Dark Census: Statistically Detecting the Satellite Populations of Distant Galaxies
• Stellar Velocity Dispersion: Linking Quiescent Galaxies to their Dark Matter Halos
• The inner mass power spectrum of galaxies using strong gravitational lensing: beyond linear approximation
• Statistical and systematic uncertainties in pixel-based source reconstruction algorithms for gravitational lensing
• Probing the small-scale structure in strongly lensed systems via transdimensional inference
• Stellar Wakes from Dark Matter Subhalos
• Beyond subhalos: Probing the collective effect of the Universe's small-scale structure with gravitational lensing
• The dark matter transfer function: free streaming, particle statistics and memory of gravitational clustering
• Probing the Fundamental Nature of Dark Matter with the Large Synoptic Survey Telescope
• Likelihood-free MCMC with Amortized Approximate Ratio Estimators
• The cosmological lens equation and the equivalent single-plane gravitational lens
• Point Sources from Dissipative Dark Matter
• Analyzing interferometric observations of strong gravitational lenses with recurrent and convolutional neural networks
• Quantifying the power spectrum of small-scale structure in semi-analytic galaxies
• On the use of shapelets in modelling resolved, gravitationally lensed images
• Neural Autoregressive Distribution Estimation
• Adversarial Variational Optimization of Non-Differentiable Simulators
• Dynamic Likelihood-free Inference via Ratio Estimation (DIRE)
• Strong Lensing considerations for the LSST observing strategy
• Understanding Dwarf Galaxies in order to Understand Dark Matter

Cited by in corpus (49)

• Ultra-Light Dark Matter
• Mining gold from implicit models to improve likelihood-free inference
• The DAWES review 10: The impact of deep learning for the analysis of galaxy surveys
• Hierarchical Inference With Bayesian Neural Networks: An Application to Strong Gravitational Lensing
• Deep Learning the Morphology of Dark Matter Substructure
• From Images to Dark Matter: End-To-End Inference of Substructure From Hundreds of Strong Gravitational Lenses
• Implications of Milky Way Substructures for the Nature of Dark Matter
• Differentiable Strong Lensing: Uniting Gravity and Neural Nets through Differentiable Probabilistic Programming
• The sum of the masses of the Milky Way and M31: a likelihood-free inference approach
• Convolutional Neural Networks for Direct Detection of Dark Matter
• Quantifying the Line-of-Sight Halo Contribution to the Dark Matter Convergence Power Spectrum from Strong Gravitational Lenses
• Using wavelets to capture deviations from smoothness in galaxy-scale strong lenses
• Estimating the warm dark matter mass from strong lensing images with truncated marginal neural ratio estimation
• Strong Lensing by Galaxies
• Strong lens modelling: comparing and combining Bayesian neural networks and parametric profile fitting
• Extracting the Subhalo Mass Function from Strong Lens Images with Image Segmentation
• Towards constraining warm dark matter with stellar streams through neural simulation-based inference
• Image segmentation for analyzing galaxy-galaxy strong lensing systems
• Likelihood-free MCMC with Amortized Approximate Ratio Estimators
• Astrophysical Tests of Dark Matter Self-Interactions
• Lightning-Fast Gravitational Wave Parameter Inference through Neural Amortization
• Single frequency CMB B-mode inference with realistic foregrounds from a single training image
• One never walks alone: the effect of the perturber population on subhalo measurements in strong gravitational lenses
• Using Machine Learning to disentangle LHC signatures of Dark Matter candidates
• Decoding Dark Matter Substructure without Supervision
• Evidence Networks: simple losses for fast, amortized, neural Bayesian model comparison
• A Framework for Obtaining Accurate Posteriors of Strong Gravitational Lensing Parameters with Flexible Priors and Implicit Likelihoods using Density Estimation
• Strong-lensing source reconstruction with variationally optimised Gaussian processes
• Debiasing Standard Siren Inference of the Hubble Constant with Marginal Neural Ratio Estimation
• Quantifying the structure of strong gravitational lens potentials with uncertainty-aware deep neural networks
• Deep learning the astrometric signature of dark matter substructure
• Subhalo effective density slope measurements from HST strong lensing data with neural likelihood-ratio estimation
• Modeling lens potentials with continuous neural fields in galaxy-scale strong lenses
• Targeted Likelihood-Free Inference of Dark Matter Substructure in Strongly-Lensed Galaxies
• Inferring subhalo effective density slopes from strong lensing observations with neural likelihood-ratio estimation
• A machine learning-based methodology for pulse classification in dual-phase xenon time projection chambers
• Dark Matter Subhalos, Strong Lensing and Machine Learning
• Sensitivity Estimation for Dark Matter Subhalos in Synthetic Gaia DR2 using Deep Learning
• HNPE: Leveraging Global Parameters for Neural Posterior Estimation
• A forward-modelling method to infer the dark matter particle mass from strong gravitational lenses
• Hunting for Dark Matter Subhalos in Strong Gravitational Lensing with Neural Networks
• A Modular Deep Learning Pipeline for Galaxy-Scale Strong Gravitational Lens Detection and Modeling
• Simulation-based Bayesian inference for multi-fingered robotic grasping
• Detecting the hidden population of low-mass haloes in strong lenses
• Robustness of Neural Ratio and Posterior Estimators to Distributional Shifts for Population-Level Dark Matter Analysis in Strong Gravitational Lensing
• Deep inference of simulated strong lenses in ground-based surveys
• LSST Strong Lensing Systems Dark Matter Sensitivity Analysis with Neural Ratio Estimators
• Quantifying Weighted Morphological Content of Large-Scale Structures via Simulation-Based Inference
• Probing Dark Matter with Strong Gravitational Lensing through an Effective Density Slope