Likelihood-free inference with neural compression of DES SV weak lensing map statistics

Abstract

In many cosmological inference problems, the likelihood (the probability of the observed data as a function of the unknown parameters) is unknown or intractable. This necessitates approximations and assumptions, which can lead to incorrect inference of cosmological parameters, including the nature of dark matter and dark energy, or create artificial model tensions. Likelihood-free inference covers a novel family of methods to rigorously estimate posterior distributions of parameters using forward modelling of mock data. We present likelihood-free cosmological parameter inference using weak lensing maps from the Dark Energy Survey (DES) SV data, using neural data compression of weak lensing map summary statistics. We explore combinations of the power spectra, peak counts, and neural compressed summaries of the lensing mass map using deep convolution neural networks. We demonstrate methods to validate the inference process, for both the data modelling and the probability density estimation steps. Likelihood-free inference provides a robust and scalable alternative for rigorous large-scale cosmological inference with galaxy survey data (for DES, Euclid and LSST). We have made our simulated lensing maps publicly available.

arXiv commentAccepted MNRAS, 18 pages, 10 figures, submitted MNRAS

References in corpus (76)

• The cosmological simulation code GADGET-2
• HEALPix -- a Framework for High Resolution Discretization, and Fast Analysis of Data Distributed on the Sphere
• Weak Gravitational Lensing
• Stable clustering, the halo model and nonlinear cosmological power spectra
• Variational Inference with Normalizing Flows
• Dark Energy Survey Year 1 Results: Cosmological Constraints from Galaxy Clustering and Weak Lensing
• The Dark Energy Camera
• The Dark Energy Survey: more than dark energy - an overview
• Cosmology and Fundamental Physics with the Euclid Satellite
• LSST Science Book, Version 2.0
• Power Spectra for Cold Dark Matter and its Variants
• MASTER of the CMB Anisotropy Power Spectrum: A Fast Method for Statistical Analysis of Large and Complex CMB Data Sets
• Understanding Deep Convolutional Networks
• Cosmology with cosmic shear observations: a review
• Galaxies in the Hubble Ultra Deep Field: I. Detection, Multiband Photometry, Photometric Redshifts, and Morphology
• How to measure CMB power spectra without losing information
• CFHTLenS: Combined probe cosmological model comparison using 2D weak gravitational lensing
• Solving Large Scale Structure in Ten Easy Steps with COLA
• Normalizing Flows for Probabilistic Modeling and Inference
• KiDS-450 + 2dFLenS: Cosmological parameter constraints from weak gravitational lensing tomography and overlapping redshift-space galaxy clustering
• Massive Lossless Data Compression and Multiple Parameter Estimation from Galaxy Spectra
• Fast likelihood-free cosmology with neural density estimators and active learning
• The MICE Grand Challenge Lightcone Simulation III: Galaxy lensing mocks from all-sky lensing maps
• Cosmology with the shear-peak statistics
• Cosmology from Cosmic Shear with DES Science Verification Data
• Galaxy alignments: Observations and impact on cosmology
• Constraining the thick disc formation scenario of the Milky Way
• Massive optimal data compression and density estimation for scalable, likelihood-free inference in cosmology
• Clarifying the Hubble constant tension with a Bayesian hierarchical model of the local distance ladder
• Cosmology constraints from shear peak statistics in Dark Energy Survey Science Verification data
• Weak lensing analysis in three dimensions
• Cosmological constraints with deep learning from KiDS-450 weak lensing maps
• A new approach to observational cosmology using the scattering transform
• Large fluctuations in the hydrogen-ionizing background and mean free path following the epoch of reionization
• KiDS-450: Cosmological Constraints from Weak Lensing Peak Statistics - II: Inference from Shear Peaks using N-body Simulations
• Nuisance hardened data compression for fast likelihood-free inference
• KiDS-450: Cosmological Constraints from Weak Lensing Peak Statistics-I: Inference from Analytical Prediction of High Signal-to-Noise Ratio Convergence Peaks
• Automatic physical inference with information maximising neural networks
• Approximate Bayesian Computation for Astronomical Model Analysis: A Case Study in Galaxy Demographics and Morphological Transformation at High Redshift
• Likelihood-Free Cosmological Inference with Type Ia Supernovae: Approximate Bayesian Computation for a Complete Treatment of Uncertainty
• Weak lensing cosmology with convolutional neural networks on noisy data
• Generalized massive optimal data compression
• Approximate Bayesian Computation for Forward Modeling in Cosmology
• CARS: The CFHTLS-Archive-Research Survey III. First detection of cosmic magnification in samples of normal high-z galaxies
• Maximum-entropy weak lens reconstruction: improved methods and application to data
• cosmoabc: Likelihood-free inference via Population Monte Carlo Approximate Bayesian Computation
• Cosmological constraints from noisy convergence maps through deep learning
• Bayesian optimisation for likelihood-free cosmological inference
• Hierarchical Cosmic Shear Power Spectrum Inference
• A new model to predict weak-lensing peak counts II. Parameter constraint strategies
• On the complementarity of galaxy clustering with cosmic shear and flux magnification
• Deep learning dark matter map reconstructions from DES SV weak lensing data
• Cosmological parameters, shear maps and power spectra from CFHTLenS using Bayesian hierarchical inference
• Inferring the mass of sub-millimetre galaxies by exploiting their gravitational magnification of background galaxies
• High Resolution Weak Lensing Mass-Mapping Combining Shear and Flexion
• On the insufficiency of arbitrarily precise covariance matrices: non-Gaussian weak lensing likelihoods
• Shear and Magnification: Cosmic Complementarity
• Improving Weak Lensing Mass Map Reconstructions using Gaussian and Sparsity Priors: Application to DES SV
• Approximate Bayesian Computation in Large Scale Structure: constraining the galaxy-halo connection
• Cosmological constraints with weak lensing peak counts and second-order statistics in a large-field survey
• The skewed weak lensing likelihood: why biases arise, despite data and theory being sound
• Wide-Field Lensing Mass Maps from DES Science Verification Data
• Consistency tests in cosmology using relative entropy
• Denoising Weak Lensing Mass Maps with Deep Learning
• Cosmic Shear: Inference from Forward Models
• Effects of baryons on weak lensing peak statistics
• Weak Lensing with Sizes, Magnitudes and Shapes
• Combining Size and Shape in Weak Lensing
• Measurement of the B-band Galaxy Luminosity Function with Approximate Bayesian Computation
• Accelerating Approximate Bayesian Computation with Quantile Regression: Application to Cosmological Redshift Distributions
• Sparse Bayesian mass-mapping with uncertainties: local credible intervals
• Inferring the photometric and size evolution of galaxies from image simulations
• Spectro-Imaging Forward Model of Red and Blue Galaxies
• Mapping dark matter on the celestial sphere with weak gravitational lensing
• Flow-Based Likelihoods for Non-Gaussian Inference
• Dark energy constraints and correlations with systematics from CFHTLS weak lensing, SNLS supernovae Ia and WMAP5

Cited by in corpus (77)

• The CAMELS project: Cosmology and Astrophysics with MachinE Learning Simulations
• The DAWES review 10: The impact of deep learning for the analysis of galaxy surveys
• Dark Energy Survey Year 3 results: curved-sky weak lensing mass map reconstruction
• Cosmic Shear Cosmology Beyond 2-Point Statistics: A Combined Peak Count and Correlation Function Analysis of DES-Y1
• Dark Energy Survey Year 3 results: cosmological constraints from the analysis of cosmic shear in harmonic space
• The CAMELS Multifield Dataset: Learning the Universe's Fundamental Parameters with Artificial Intelligence
• Non-Gaussian estimates of tensions in cosmological parameters
• Weak lensing scattering transform: dark energy and neutrino mass sensitivity
• Inference of the optical depth to reionization from low multipole temperature and polarisation Planck data
• Lifting weak lensing degeneracies with a field-based likelihood
• Learning cosmology and clustering with cosmic graphs
• Importance nested sampling with normalising flows
• Cosmology with one galaxy?
• The integrated 3-point correlation function of cosmic shear
• The Cosmic Graph: Optimal Information Extraction from Large-Scale Structure using Catalogues
• Accelerated Bayesian SED Modeling using Amortized Neural Posterior Estimation
• Probabilistic Mass Mapping with Neural Score Estimation
• LtU-ILI: An All-in-One Framework for Implicit Inference in Astrophysics and Cosmology
• The sum of the masses of the Milky Way and M31: a likelihood-free inference approach
• Persistent homology in cosmic shear II: A tomographic analysis of DES-Y1
• $\mathrm{S}\mathrm{IM}\mathrm{BIG}$: Mock Challenge for a Forward Modeling Approach to Galaxy Clustering
• A Parameter-Masked Mock Data Challenge for Beyond-Two-Point Galaxy Clustering Statistics
• Dim but not entirely dark: Extracting the Galactic Center Excess' source-count distribution with neural nets
• KiDS-SBI: Simulation-based inference analysis of KiDS-1000 cosmic shear
• GLASS: Generator for Large Scale Structure
• EFTofLSS meets simulation-based inference: ${\sigma }_8$ from biased tracers
• A robust estimator of mutual information for deep learning interpretability
• KaRMMa -- Kappa Reconstruction for Mass Mapping
• The PAU Survey: Measurement of Narrow-band galaxy properties with Approximate Bayesian Computation
• Single frequency CMB B-mode inference with realistic foregrounds from a single training image
• Multifield Cosmology with Artificial Intelligence
• A comparative study of cosmological constraints from weak lensing using Convolutional Neural Networks
• Data Compression and Inference in Cosmology with Self-Supervised Machine Learning
• A simulation-based inference pipeline for cosmic shear with the Kilo-Degree Survey
• Towards a full $w$CDM map-based analysis for weak lensing surveys
• Cosmological constraints from weak lensing scattering transform using HSC Y1 data
• Cosmological Parameter Estimation and Inference using Deep Summaries
• Machine Learning and Cosmology
• Evidence Networks: simple losses for fast, amortized, neural Bayesian model comparison
• Neural Simulation-Based Inference of the Neutron Star Equation of State directly from Telescope Spectra
• Likelihood-free Forward Modeling for Cluster Weak Lensing and Cosmology
• Forecasting the power of Higher Order Weak Lensing Statistics with automatically differentiable simulations
• Cosmological Tests of Gravity: A Future Perspective
• Bayesian evidence-driven likelihood selection for sky-averaged 21-cm signal extraction
• Fast likelihood-free inference in the LSS Stage IV era
• The integrated angular bispectrum of weak lensing
• Simulation-Based Inference Benchmark for Weak Lensing Cosmology
• Learning the Universe: Cosmological and Astrophysical Parameter Inference with Galaxy Luminosity Functions and Colours
• Cosmological constraints from low redshift 21 cm intensity mapping with machine learning
• A tomographic spherical mass map emulator of the KiDS-1000 survey using conditional generative adversarial networks
• Full-waveform earthquake source inversion using simulation-based inference
• Almanac: MCMC-based signal extraction of power spectra and maps on the sphere
• Inpainting hydrodynamical maps with deep learning
• What does a cosmological experiment really measure? Covariant posterior decomposition with normalizing flows
• Massive $\nu$s through the CNN lens: interpreting the field-level neutrino mass information in weak lensing
• A Simulation Based Inference Approach to the Dynamics of the MW-LMC System -- Validation
• Cosmology from Point Clouds with Dark Matter Halos from the Quijote Simulations
• Simulation-based inference has its own Dodelson-Schneider effect (but it knows that it does)
• Hybrid summary statistics: neural weak lensing inference beyond the power spectrum
• Data-Space Validation of High-Dimensional Models by Comparing Sample Quantiles
• Position-Dependent Correlation Function of Weak Lensing Convergence
• The Cosmological analysis of X-ray cluster surveys VII. Bypassing scaling relations with Lagrangian Deep Learning and Simulation-based inference
• Modern Bayesian Sampling Methods for Cosmological Inference: A Comparative Study
• Weak Gravitational Lensing
• A Minkowski Functional Analysis of the Cosmic Microwave Background Weak Lensing Convergence
• Inferring halo masses with Graph Neural Networks
• Distribution-free uncertainty quantification for inverse problems: application to weak lensing mass mapping
• A data compression and optimal galaxy weights scheme for Dark Energy Spectroscopic Instrument and weak lensing datasets
• Exploring Machine Learning Regression Models for Advancing Foreground Mitigation and Global 21cm Signal Parameter Extraction
• Towards an optimal extraction of cosmological parameters from galaxy cluster surveys using convolutional neural networks
• Quantifying the Milky Way, LMC and their interaction using all-sky kinematics of outer halo stars
• Probabilistic Spectral Reconstruction of Trans-Neptunian Objects from Sparse Photometry: A Framework for Taxonomy, Survey Optimization, and Outlier Detection
• $\text{SBi3PCF:}$ Simulation-based inference with the integrated 3PCF
• Dark Energy Survey Year 3 results: Cosmology with peaks using an emulator approach
• Quantifying Weighted Morphological Content of Large-Scale Structures via Simulation-Based Inference
• Generative modeling of convergence maps based on predicted one-point statistics
• Dark Energy Survey Year 3 Results: Three-Point Shear Correlations and Mass Aperture Moments