Estimating Cosmological Parameter Covariance

Abstract

We investigate the bias and error in estimates of the cosmological parameter covariance matrix, due to sampling or modelling the data covariance matrix, for likelihood width and peak scatter estimators. We show that these estimators do not coincide unless the data covariance is exactly known. For sampled data covariances, with Gaussian distributed data and parameters, the parameter covariance matrix estimated from the width of the likelihood has a Wishart distribution, from which we derive the mean and covariance. This mean is biased and we propose an unbiased estimator of the parameter covariance matrix. Comparing our analytic results to a numerical Wishart sampler of the data covariance matrix we find excellent agreement. An accurate ansatz for the mean parameter covariance for the peak scatter estimator is found, and we fit its covariance to our numerical analysis. The mean is again biased and we propose an unbiased estimator for the peak parameter covariance. For sampled data covariances the width estimator is more accurate than the peak scatter estimator. We investigate modelling the data covariance, or equivalently data compression, and shown that the peak scatter estimator is less sensitive to biases in the model data covariance matrix than the width estimator, but requires independent realisations of the data to reduce the statistical error. If the model bias on the peak estimator is sufficiently low this is promising, otherwise the sampled width estimator is preferable.

12 pages, 10 figures, submitted to MNRAS

References in corpus (5)

• Why your model parameter confidences might be too optimistic -- unbiased estimation of the inverse covariance matrix
• The Clustering of Galaxies in the SDSS-III Baryon Oscillation Spectroscopic Survey: Including covariance matrix errors
• Probing dark energy with cluster counts and cosmic shear power spectra: including the full covariance
• Analysis of two-point statistics of cosmic shear: III. Covariances of shear measures made easy
• Shrinkage Estimation of the Power Spectrum Covariance Matrix

Cited by in corpus (76)

• KiDS-450: Cosmological parameter constraints from tomographic weak gravitational lensing
• Data Analysis for Precision 21 cm Cosmology
• The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: cosmological implications of the configuration-space clustering wedges
• Cosmology constraints from shear peak statistics in Dark Energy Survey Science Verification data
• Gaussian covariance matrices for anisotropic galaxy clustering measurements
• KiDS-450: Cosmological Constraints from Weak Lensing Peak Statistics - II: Inference from Shear Peaks using N-body Simulations
• Lyα emission line reconstruction for high-$z$ QSOs
• Cosmological constraints from BOSS with analytic covariance matrices
• The VIMOS Public Extragalactic Redshift Survey (VIPERS). Gravity test from the combination of redshift-space distortions and galaxy-galaxy lensing at $0.5<z<1.2$
• Analytic model for the matter power spectrum, its covariance matrix, and baryonic effects
• Dark Energy Survey Year 3 Results: Covariance Modelling and its Impact on Parameter Estimation and Quality of Fit
• Cosmic Shear Results from the Deep Lens Survey - II: Full Cosmological Parameter Constraints from Tomography
• 2D-FFTLog: Efficient computation of real space covariance matrices for galaxy clustering and weak lensing
• The clustering of the SDSS-IV extended Baryon Oscillation Spectroscopic Survey DR14 quasar sample: anisotropic clustering analysis in configuration-space
• Improving fast generation of halo catalogs with higher-order Lagrangian perturbation theory
• Characterizing Signal Loss in the 21 cm Reionization Power Spectrum: A Revised Study of PAPER-64
• Fewer Mocks and Less Noise: Reducing the Dimensionality of Cosmological Observables with Subspace Projections
• Perturbation theory approach to predict the covariance matrices of the galaxy power spectrum and bispectrum in redshift space
• Performance of internal Covariance Estimators for Cosmic Shear Correlation Functions
• Massive data compression for parameter-dependent covariance matrices
• KiDS+GAMA: Constraints on Horndeski gravity from combined large-scale structure probes
• Toward a robust inference method for the galaxy bispectrum: likelihood function and model selection
• Cosmic Shear Covariance Matrix in $w$CDM: Cosmology Matters
• On the insufficiency of arbitrarily precise covariance matrices: non-Gaussian weak lensing likelihoods
• Matter Power Spectrum Covariance Matrix from the DEUS-PUR ΛCDM simulations: Mass Resolution and non-Gaussian Errors
• Maximal compression of the redshift space galaxy power spectrum and bispectrum
• Improving the precision matrix for precision cosmology
• Sample variance in weak lensing: how many simulations are required?
• Quantifying lost information due to covariance matrix estimation in parameter inference
• The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: Angular clustering tomography and its cosmological implications
• Dark Energy Survey Year 1 Results: galaxy mock catalogues for BAO
• Power spectrum multipoles on the curved sky: an application to the 6-degree Field Galaxy Survey
• CFHTLenS and RCSLenS Cross-Correlation with Planck Lensing Detected in Fourier and Configuration Space
• Non-linear shrinkage estimation of large-scale structure covariance
• Revisiting CFHTLenS cosmic shear: Optimal E/B mode decomposition using COSEBIs and compressed COSEBIs
• RascalC: A Jackknife Approach to Estimating Single and Multi-Tracer Galaxy Covariance Matrices
• Precision matrix expansion - efficient use of numerical simulations in estimating errors on cosmological parameters
• KiDS-450: Tomographic Cross-Correlation of Galaxy Shear with {\it Planck} Lensing
• Probing dark energy with tomographic weak-lensing aperture mass statistics
• Towards a self-consistent analysis of the anisotropic galaxy two- and three-point correlation functions on large scales: application to mock galaxy catalogues
• Cross-correlation of weak lensing and gamma rays: implications for the nature of dark matter
• BAO from angular clustering: optimization and mitigation of theoretical systematics
• Estimating the power spectrum covariance matrix with fewer mock samples
• Non-Linear Matter Power Spectrum Covariance Matrix Errors and Cosmological Parameter Uncertainties
• A fast, always positive definite and normalizable approximation of non-Gaussian likelihoods
• Analytic Gaussian Covariance Matrices for Galaxy $N$-Point Correlation Functions
• Cosmology with photometric weak lensing surveys: constraints with redshift tomography of convergence peaks and moments
• Testing gravity with galaxy-galaxy lensing and redshift-space distortions using CFHT-Stripe 82, CFHTLenS and BOSS CMASS datasets
• Constraining cosmology with shear peak statistics: tomographic analysis
• Fast Weak Lensing Simulations with Halo Model
• Estimating sparse precision matrices
• Non-Gaussianity in the Weak Lensing Correlation Function Likelihood -- Implications for Cosmological Parameter Biases
• New constraints on cosmological modified gravity theories from anisotropic three-point correlation functions of BOSS DR12 galaxies
• Debiasing inference with approximate covariance matrices and other unidentified biases
• It takes two to know one: Computing accurate one-point PDF covariances from effective two-point PDF models
• Fast and realistic large-scale structure from machine-learning-augmented random field simulations
• Accurate halo-galaxy mocks from automatic bias estimation and particle mesh gravity solvers
• COVMOS: a new Monte Carlo approach for galaxy clustering analysis
• Robustness of the covariance matrix for galaxy clustering measurements
• A New Data Compression Method and its Application to Cosmic Shear Analysis
• The Impact of Realistic Foreground and Instrument Models on 21cm Epoch of Reionization Experiments
• Describing variations of the Fisher-matrix across parameter space
• Fast generation of weak lensing maps by the inverse-Gaussianization method
• GEOMAX: beyond linear compression for 3pt galaxy clustering statistics
• Testing the accuracy of likelihoods for cluster abundance cosmology
• Bayesian Control Variates for optimal covariance estimation with pairs of simulations and surrogates
• KiDS-Legacy: Covariance validation and the unified OneCovariance framework for projected large-scale structure observables
• Two-point statistics without bins: A continuous-function generalization of the correlation function estimator for large-scale structure
• Cosmological inference including massive neutrinos from the matter power spectrum: biases induced by uncertainties in the covariance matrix
• Simulation-based inference has its own Dodelson-Schneider effect (but it knows that it does)
• Euclid: Fast two-point correlation function covariance through linear construction
• A comparison of shrinkage estimators of the cosmological precision matrix
• Optimal data compression for Lyman-$\alpha$ forest cosmology
• Origin & evolution of the Universe
• Residual Smoothing: Using Mocks to Correct Model Covariance Matrices
• Matching Bayesian and frequentist coverage probabilities when using an approximate data covariance matrix