Putting the Precision in Precision Cosmology: How accurate should your data covariance matrix be?

Abstract

Cosmological parameter estimation requires that the likelihood function of the data is accurately known. Assuming that cosmological large-scale structure power spectra data are multivariate Gaussian-distributed, we show the accuracy of parameter estimation is limited by the accuracy of the inverse data covariance matrix - the precision matrix. If the data covariance and precision matrices are estimated by sampling independent realisations of the data, their statistical properties are described by the Wishart and Inverse-Wishart distributions, respectively. Independent of any details of the survey, we show that the fractional error on a parameter variance, or a Figure-of-Merit, is equal to the fractional variance of the precision matrix. In addition, for the only unbiased estimator of the precision matrix, we find that the fractional accuracy of the parameter error depends only on the difference between the number of independent realisations and the number of data points, and so can easily diverge. For a 5% error on a parameter error and N_D << 100 data-points, a minimum of 200 realisations of the survey are needed, with 10% accuracy for the data covariance. If the number of data-points N_D >>100 we need N_S > N_D realisations and a fractional accuracy of <sqrt[2/N_D] in the data covariance. As the number of power spectra data points grows to N_D>10^4 -10^6 this approach will be problematic. We discuss possible ways to relax these conditions: improved theoretical modelling; shrinkage methods; data-compression; simulation and data resampling methods.

21 pages, 10 figures, submitted to MNRAS

References in corpus (12)

• Dynamics of dark energy
• Why your model parameter confidences might be too optimistic -- unbiased estimation of the inverse covariance matrix
• Report of the Dark Energy Task Force
• Simulations of Baryon Acoustic Oscillations II: Covariance matrix of the matter power spectrum
• Probing dark energy with the shear-ratio geometric test
• Probing dark energy with cluster counts and cosmic shear power spectra: including the full covariance
• Estimation of Polarized Power Spectra by Gibbs sampling
• Shrinkage Estimation of the Power Spectrum Covariance Matrix
• Likelihood methods for the combined analysis of CMB temperature and polarisation power spectra
• Properties and use of CMB power spectrum likelihoods
• Size magnification as a complement to Cosmic Shear
• Marginal distributions for cosmic variance limited CMB polarization data

Cited by in corpus (170)

• Cosmology with cosmic shear observations: a review
• Weak lensing for precision cosmology
• Dark energy two decades after: Observables, probes, consistency tests
• The clustering of galaxies in the SDSS-III Baryon Oscillation Spectroscopic Survey: mock galaxy catalogues for the BOSS Final Data Release
• The Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: measurement of the BAO and growth rate of structure of the luminous red galaxy sample from the anisotropic power spectrum between redshifts 0.6 and 1.0
• CosmoLike - Cosmological Likelihood Analyses for Photometric Galaxy Surveys
• The Clustering of Galaxies in the SDSS-III Baryon Oscillation Spectroscopic Survey: Including covariance matrix errors
• Parameter inference with estimated covariance matrices
• The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: cosmological implications of the configuration-space clustering wedges
• Mock galaxy catalogs using the quick particle mesh method
• Dark Energy Survey Year 1 Results: Measurement of the Baryon Acoustic Oscillation scale in the distribution of galaxies to redshift 1
• The Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: measurement of the BAO and growth rate of structure of the emission line galaxy sample from the anisotropic power spectrum between redshift 0.6 and 1.1
• CFHTLenS: Cosmological constraints from a combination of cosmic shear two-point and three-point correlations
• Cosmology from Cosmic Shear with DES Science Verification Data
• The clustering of galaxies in the SDSS-III Baryon Oscillation Spectroscopic Survey: cosmological implications of the full shape of the clustering wedges in the data release 10 and 11 galaxy samples
• Full-sky Gravitational Lensing Simulation for Large-area Galaxy Surveys and Cosmic Microwave Background Experiments
• The SDSS-IV extended Baryon Oscillation Spectroscopic Survey: Baryon Acoustic Oscillations at redshift of 0.72 with the DR14 Luminous Red Galaxy Sample
• Cosmology constraints from shear peak statistics in Dark Energy Survey Science Verification data
• Gaussian covariance matrices for anisotropic galaxy clustering measurements
• Growth of Cosmic Structure: Probing Dark Energy Beyond Expansion
• The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: Cosmological implications of the Fourier space wedges of the final sample
• Galaxy-galaxy lensing estimators and their covariance properties
• 3D Cosmic Shear: Cosmology from CFHTLenS
• CMB lensing tomography with the DES Science Verification galaxies
• Cosmology with the Wide-Field Infrared Survey Telescope -- Multi-Probe Strategies
• Galaxy Power Spectrum Multipoles Covariance in Perturbation Theory
• Cosmological constraints from BOSS with analytic covariance matrices
• Assessment of the Information Content of the Power Spectrum and Bispectrum
• ICE-COLA: Towards fast and accurate synthetic galaxy catalogues optimizing a quasi $N$-body method
• Dark Energy Survey Year 3 Results: Covariance Modelling and its Impact on Parameter Estimation and Quality of Fit
• 2D-FFTLog: Efficient computation of real space covariance matrices for galaxy clustering and weak lensing
• Estimating Cosmological Parameter Covariance
• Comparing approximate methods for mock catalogues and covariance matrices II: Power spectrum multipoles
• Comparing approximate methods for mock catalogues and covariance matrices I: correlation function
• The clustering of the SDSS-IV extended Baryon Oscillation Spectroscopic Survey DR14 quasar sample: anisotropic clustering analysis in configuration-space
• Dark matter statistics for large galaxy catalogs: power spectra and covariance matrices
• A Detection of the Baryon Acoustic Oscillation Features in the SDSS BOSS DR12 Galaxy Bispectrum
• Simulations of Weak Gravitational Lensing - II : Including Finite Support Effects in Cosmic Shear Covariance Matrices
• Cross-correlating Planck CMB lensing with SDSS: Lensing-lensing and galaxy-lensing cross-correlations
• Improving fast generation of halo catalogs with higher-order Lagrangian perturbation theory
• Scientific Synergy Between LSST and Euclid
• Accurate cosmic shear errors: do we need ensembles of simulations?
• Perturbation theory approach to predict the covariance matrices of the galaxy power spectrum and bispectrum in redshift space
• Fewer Mocks and Less Noise: Reducing the Dimensionality of Cosmological Observables with Subspace Projections
• Performance of internal Covariance Estimators for Cosmic Shear Correlation Functions
• Five-percent measurements of the growth rate from simulation-based modelling of redshift-space clustering in BOSS LOWZ
• On the Probability Distributions of Ellipticity
• Toward a robust inference method for the galaxy bispectrum: likelihood function and model selection
• Disconnected pseudo-$C_{\ell }$ covariances for projected large-scale structure data
• Primordial non-Gaussianity without tails -- how to measure fNL with the bulk of the density PDF
• Cosmological parameters from the likelihood analysis of the galaxy power spectrum and bispectrum in real space
• Mocking the Weak Lensing universe: the LensTools python computing package
• On the insufficiency of arbitrarily precise covariance matrices: non-Gaussian weak lensing likelihoods
• Cosmic variance of the galaxy cluster weak lensing signal
• Mock galaxy shape catalogs in the Subaru Hyper Suprime-Cam Survey
• The BACCO simulation project: biased tracers in real space
• Matter Power Spectrum Covariance Matrix from the DEUS-PUR ΛCDM simulations: Mass Resolution and non-Gaussian Errors
• The cosmological information of shear peaks: beyond the abundance
• Cosmology with the Wide-Field Infrared Survey Telescope -- Synergies with the Rubin Observatory Legacy Survey of Space and Time
• Robust covariance estimation of galaxy-galaxy weak lensing: validation and limitation of jackknife covariance
• Improving the precision matrix for precision cosmology
• Probing gravity with a joint analysis of galaxy and CMB lensing and SDSS spectroscopy
• Sample variance in weak lensing: how many simulations are required?
• Quantifying lost information due to covariance matrix estimation in parameter inference
• The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: Angular clustering tomography and its cosmological implications
• Large Covariance Matrices: Smooth Models from the 2-Point Correlation Function
• Robust Field-level Likelihood-free Inference with Galaxies
• Discrepancies between CFHTLenS cosmic shear & Planck: new physics or systematic effects?
• The integrated 3-point correlation function of cosmic shear
• The Bacco Simulation Project: Bacco Hybrid Lagrangian Bias Expansion Model in Redshift Space
• The mass dependence of dark matter halo alignments with large-scale structure
• CFHTLenS and RCSLenS Cross-Correlation with Planck Lensing Detected in Fourier and Configuration Space
• Beware of commonly used approximations II: estimating systematic biases in the best-fit parameters
• Updated Results on the Galaxy-Halo Connection from Satellite Kinematics in SDSS
• BAM: Bias Assignment Method to generate mock catalogs
• RascalC: A Jackknife Approach to Estimating Single and Multi-Tracer Galaxy Covariance Matrices
• Non-linear shrinkage estimation of large-scale structure covariance
• Precision matrix expansion - efficient use of numerical simulations in estimating errors on cosmological parameters
• Response Approach to the Matter Power Spectrum Covariance
• Towards a self-consistent analysis of the anisotropic galaxy two- and three-point correlation functions on large scales: application to mock galaxy catalogues
• Cross-correlation of weak lensing and gamma rays: implications for the nature of dark matter
• Estimating the power spectrum covariance matrix with fewer mock samples
• Galaxy 2-Point Covariance Matrix Estimation for Next Generation Surveys
• ICE-COLA: fast simulations for weak lensing observables
• Estimating Covariance Matrices for Two- and Three-Point Correlation Function Moments in Arbitrary Survey Geometries
• Non-Linear Matter Power Spectrum Covariance Matrix Errors and Cosmological Parameter Uncertainties
• Disconnected Covariance of 2-point Functions in Large-Scale Structure
• CODEX Weak Lensing: Concentration of Galaxy Clusters at z ~ 0.5
• Large Covariance Matrices: Accurate Models Without Mocks
• Analytic Gaussian Covariance Matrices for Galaxy $N$-Point Correlation Functions
• Cosmological Information in Skew Spectra of Biased Tracers in Redshift Space
• Cross-correlation of galaxies and galaxy clusters in the Sloan Digital Sky Survey and the importance of non-Poissonian shot noise
• Semi-analytical covariance matrices for two-point correlation function for DESI 2024 data
• Cosmology with photometric weak lensing surveys: constraints with redshift tomography of convergence peaks and moments
• Hierarchical probabilistic inference of cosmic shear
• Cosmological inference from emulator based halo model I: Validation tests with HSC and SDSS mock catalogs
• Non-fiducial cosmological test from geometrical and dynamical distortions around voids
• Estimating sparse precision matrices
• Fast Generation of Covariance Matrices for Weak Lensing
• SDSS-III Baryon Oscillation Spectroscopic Survey: Analysis of Potential Systematics in Fitting of Baryon Acoustic Feature
• Non-Gaussianity in the Weak Lensing Correlation Function Likelihood -- Implications for Cosmological Parameter Biases
• New constraints on cosmological modified gravity theories from anisotropic three-point correlation functions of BOSS DR12 galaxies
• Testing General Relativity on cosmological scales at redshift z ~ 1.5 with quasar and CMB lensing
• x-cut Cosmic Shear: Optimally Removing Sensitivity to Baryonic and Nonlinear Physics with an Application to the Dark Energy Survey Year 1 Shear Data
• PINGU and the neutrino mass hierarchy: Statistical and systematic aspects
• Suppressing cosmic variance with paired-and-fixed cosmological simulations: average properties and covariances of dark matter clustering statistics
• Debiasing inference with approximate covariance matrices and other unidentified biases
• A First Detection of the Connected 4-Point Correlation Function of Galaxies Using the BOSS CMASS Sample
• Inference from the small scales of cosmic shear with current and future Dark Energy Survey data
• Measurement of $H(z)$ and $D_A(z)$ from the two-dimensional power spectrum of Sloan Digital Sky Survey luminous red galaxies
• Euclid: Effect of sample covariance on the number counts of galaxy clusters
• The bias of dark matter tracers: assessing the accuracy of mapping techniques
• Modelling galaxy clustering in redshift space with a Lagrangian bias formalism and $N$-body simulations
• Effects of long-wavelength fluctuations in large galaxy surveys
• A Bayesian method for combining theoretical and simulated covariance matrices for large-scale structure surveys
• CFHTLenS: A Gaussian likelihood is a sufficient approximation for a cosmological analysis of third-order cosmic shear statistics
• Cosmological Inference from Galaxy-Clustering Power Spectrum: Gaussianization and Covariance Decomposition
• The PDF perspective on the tracer-matter connection: Lagrangian bias and non-Poissonian shot noise
• It takes two to know one: Computing accurate one-point PDF covariances from effective two-point PDF models
• Cosmological parameter inference from galaxy clustering: The effect of the posterior distribution of the power spectrum
• One simulation to have them all: performance of the Bias Assignment Method against N-body simulations
• Maturing Satellite Kinematics into a Competitive Probe of the Galaxy-Halo Connection
• Fast and realistic large-scale structure from machine-learning-augmented random field simulations
• A simulation-based inference pipeline for cosmic shear with the Kilo-Degree Survey
• Accurate halo-galaxy mocks from automatic bias estimation and particle mesh gravity solvers
• Covariances for cosmic shear and galaxy-galaxy lensing in the response approach
• COVMOS: a new Monte Carlo approach for galaxy clustering analysis
• Including parameter dependence in the data and covariance for cosmological inference
• Robustness of the covariance matrix for galaxy clustering measurements
• Robust and efficient CMB lensing power spectrum from polarization surveys
• Hybrid-basis inference for large-scale galaxy clustering: combining spherical and Cartesian Fourier analyses
• Rainbow Cosmic Shear: Optimisation of Tomographic Bins
• Fitting covariance matrix models to simulations
• Describing variations of the Fisher-matrix across parameter space
• Fast generation of weak lensing maps by the inverse-Gaussianization method
• Indra: a Public Computationally Accessible Suite of Cosmological $N$-body Simulations
• Constraining Dark Energy With Stacked Concave Lenses
• Optimising Spectroscopic and Photometric Galaxy Surveys: Same-sky Benefits for Dark Energy and Modified Gravity
• Integrated Sachs-Wolfe map reconstruction in the presence of systematic errors
• Bayesian Control Variates for optimal covariance estimation with pairs of simulations and surrogates
• Galaxy blending effects in deep imaging cosmic shear probes of cosmology
• Remapping simulated halo catalogues in redshift space
• KiDS-Legacy: Covariance validation and the unified OneCovariance framework for projected large-scale structure observables
• Field-level simulation-based inference with galaxy catalogs: the impact of systematic effects
• The Velocity Distribution Function of Galaxy Clusters as a Cosmological Probe
• Fast estimation of aperture-mass statistics I: aperture mass variance and an application to the CFHTLenS data
• The Weak Lensing Peak Statistics in the Mocks by the inverse-Gaussianization Method
• Cluster Cosmology with the Velocity Distribution Function of the HeCS-SZ Sample
• Faster cosmological analysis with power spectrum without simulations
• Cosmological inference including massive neutrinos from the matter power spectrum: biases induced by uncertainties in the covariance matrix
• Simulation-based inference has its own Dodelson-Schneider effect (but it knows that it does)
• Decorrelating the errors of the galaxy correlation function with compact transformation matrices
• Euclid: Fast two-point correlation function covariance through linear construction
• Baryon acoustic oscillations from a joint analysis of the large-scale clustering in Fourier and configuration space
• Non-Gaussian statistics in galaxy weak lensing: compressed three-point correlations and cosmological forecasts
• An Alcock-Paczynski Test on Reionization Bubbles for Cosmology
• A comparison of shrinkage estimators of the cosmological precision matrix
• The Completed SDSS-IV Extended Baryon Oscillation Spectroscopic Survey: Growth rate of structure measurement from cosmic voids
• An analytic approximation to the covariance between pre- and post-reconstruction galaxy two-point statistics
• Euclid: Exploring observational systematics in cluster cosmology -- a comprehensive analysis of cluster counts and clustering
• Super sample covariance and the volume scaling of galaxy survey covariance matrices
• Cosmological measurements from the CMB and BAO are insensitive to the tail probability in the assumed likelihood
• Cosmological constraints from cosmic homogeneity
• Dark Energy Survey Year 3 Results: Three-Point Shear Correlations and Mass Aperture Moments
• Cosmic Shear in Harmonic Space from the Dark Energy Survey Year 1 Data: Compatibility with Configuration Space Results
• The Parameter-Level Performance of Covariance Matrix Conditioning in Cosmic Microwave Background Data Analyses
• Matching Bayesian and frequentist coverage probabilities when using an approximate data covariance matrix
• The Kaiser-Rocket effect: three decades and counting
• Improving cosmological covariance matrices with machine learning
• Bias on Tensor-to-Scalar Ratio Inference With Estimated Covariance Matrices