Shrinkage Estimation of the Power Spectrum Covariance Matrix
arXiv:0711.2509 · doi:10.1111/j.1365-2966.2008.13561.x
Abstract
We seek to improve estimates of the power spectrum covariance matrix from a limited number of simulations by employing a novel statistical technique known as shrinkage estimation. The shrinkage technique optimally combines an empirical estimate of the covariance with a model (the target) to minimize the total mean squared error compared to the true underlying covariance. We test this technique on N-body simulations and evaluate its performance by estimating cosmological parameters. Using a simple diagonal target, we show that the shrinkage estimator significantly outperforms both the empirical covariance and the target individually when using a small number of simulations. We find that reducing noise in the covariance estimate is essential for properly estimating the values of cosmological parameters as well as their confidence intervals. We extend our method to the jackknife covariance estimator and again find significant improvement, though simulations give better results. Even for thousands of simulations we still find evidence that our method improves estimation of the covariance matrix. Because our method is simple, requires negligible additional numerical effort, and produces superior results, we always advocate shrinkage estimation for the covariance of the power spectrum and other large-scale structure measurements when purely theoretical modeling of the covariance is insufficient.
9 pages, 7 figures (1 new), MNRAS, accepted. Changes to match accepted version, including an additional explanatory section with 1 figure
References in corpus (1)
Cited by in corpus (21)
- The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: Observational systematics and baryon acoustic oscillations in the correlation function
- Large-Scale Anisotropic Correlation Function of SDSS Luminous Red Galaxies
- nIFTy Cosmology: Galaxy/halo mock catalogue comparison project on clustering statistics
- Testing Lorentz symmetry with Lunar Laser Ranging
- Massive data compression for parameter-dependent covariance matrices
- Non-linear shrinkage estimation of large-scale structure covariance
- Properties and use of CMB power spectrum likelihoods
- Galaxy 2-Point Covariance Matrix Estimation for Next Generation Surveys
- Fast radio bursts trigger aftershocks resembling earthquakes, but not solar flares
- Cosmological Density Fluctuations on 100Mpc Scales and their ISW Effect
- The Atacama Cosmology Telescope: Measurement and Analysis of 1D Beams for DR4
- Removable Matter-Power-Spectrum Covariance from Bias Fluctuations
- Fitting covariance matrix models to simulations
- Bayesian Control Variates for optimal covariance estimation with pairs of simulations and surrogates
- The halo 3-point correlation function: a methodological analysis
- Cosmological inference including massive neutrinos from the matter power spectrum: biases induced by uncertainties in the covariance matrix
- Euclid: Fast two-point correlation function covariance through linear construction
- A comparison of shrinkage estimators of the cosmological precision matrix
- Euclid: Exploring observational systematics in cluster cosmology -- a comprehensive analysis of cluster counts and clustering
- Super sample covariance and the volume scaling of galaxy survey covariance matrices
- Replicating weak-lensing summary-statistic covariances with normalizing flows