Parameter inference and model comparison using theoretical predictions from noisy simulations

Abstract

When inferring unknown parameters or comparing different models, data must be compared to underlying theory. Even if a model has no closed-form solution to derive summary statistics, it is often still possible to simulate mock data in order to generate theoretical predictions. For realistic simulations of noisy data, this is identical to drawing realizations of the data from a likelihood distribution. Though the estimated summary statistic from simulated data vectors may be unbiased, the estimator has variance which should be accounted for. We show how to correct the likelihood in the presence of an estimated summary statistic by marginalizing over the true summary statistic in the framework of a Bayesian hierarchical model. For Gaussian likelihoods where the covariance must also be estimated from simulations, we present an alteration to the Sellentin-Heavens corrected likelihood. We show that excluding the proposed correction leads to an incorrect estimate of the Bayesian evidence with JLA data. The correction is highly relevant for cosmological inference that relies on simulated data for theory (e.g. weak lensing peak statistics and simulated power spectra) and can reduce the number of simulations required.

9 pages, 6 figures, published by MNRAS. Changes: matches published version, added Bayesian hierarchical interpretation and probabilistic graphical model

References in corpus (12)

• The electronic properties of graphene
• The Complete Light-curve Sample of Spectroscopically Confirmed Type Ia Supernovae from Pan-STARRS1 and Cosmological Constraints from The Combined Pantheon Sample
• Why your model parameter confidences might be too optimistic -- unbiased estimation of the inverse covariance matrix
• Massive optimal data compression and density estimation for scalable, likelihood-free inference in cosmology
• KiDS-450: Cosmological Constraints from Weak Lensing Peak Statistics - II: Inference from Shear Peaks using N-body Simulations
• KiDS-450: Cosmological Constraints from Weak Lensing Peak Statistics-I: Inference from Analytical Prediction of High Signal-to-Noise Ratio Convergence Peaks
• Bayesian optimisation for likelihood-free cosmological inference
• An Emulator for the Lyman-alpha Forest
• Evaluating machine learning techniques for predicting power spectra from reionization simulations
• Improving Weak Lensing Mass Map Reconstructions using Gaussian and Sparsity Priors: Application to DES SV
• Cosmological constraints with weak lensing peak counts and second-order statistics in a large-field survey
• Hierarchical modeling and statistical calibration for photometric redshifts

Cited by in corpus (10)

• Cosmic Shear Cosmology Beyond 2-Point Statistics: A Combined Peak Count and Correlation Function Analysis of DES-Y1
• Cosmological Forecast for non-Gaussian Statistics in large-scale weak Lensing Surveys
• KiDS+GAMA: Constraints on Horndeski gravity from combined large-scale structure probes
• Interpreting deep learning models for weak lensing
• Beyond two-point statistics: using the minimum spanning tree as a tool for cosmology
• Primordial power spectrum and cosmology from black-box galaxy surveys
• Towards a full $w$CDM map-based analysis for weak lensing surveys
• A tomographic spherical mass map emulator of the KiDS-1000 survey using conditional generative adversarial networks
• Dark Energy Survey Year 3 results: Cosmology with peaks using an emulator approach
• The BINGO project X. Cosmological parameter constraints from HI Intensity Mapping lognormal simulations