Parameter inference with estimated covariance matrices
arXiv:1511.05969 · doi:10.1093/mnrasl/slv190
Abstract
When inferring parameters from a Gaussian-distributed data set by computing a likelihood, a covariance matrix is needed that describes the data errors and their correlations. If the covariance matrix is not known a priori, it may be estimated and thereby becomes a random object with some intrinsic uncertainty itself. We show how to infer parameters in the presence of such an estimated covariance matrix, by marginalising over the true covariance matrix, conditioned on its estimated value. This leads to a likelihood function that is no longer Gaussian, but rather an adapted version of a multivariate t-distribution, which has the same numerical complexity as the multivariate Gaussian. As expected, marginalisation over the true covariance matrix improves inference when compared with Hartlap et al.'s method, which uses an unbiased estimate of the inverse covariance matrix but still assumes that the likelihood is Gaussian.
Matches accepted MNRAS letter
References in corpus (2)
Cited by in corpus (182)
- The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: cosmological analysis of the DR12 galaxy sample
- KiDS-450: Cosmological parameter constraints from tomographic weak gravitational lensing
- Euclid. I. Overview of the Euclid mission
- The CosmoVerse White Paper: Addressing observational tensions in cosmology with systematics and fundamental physics
- KiDS-450 + 2dFLenS: Cosmological parameter constraints from weak gravitational lensing tomography and overlapping redshift-space galaxy clustering
- Improved limits on the tensor-to-scalar ratio using BICEP and Planck
- CosmoLike - Cosmological Likelihood Analyses for Photometric Galaxy Surveys
- CFHTLenS revisited: assessing concordance with Planck including astrophysical systematics
- Cosmological parameters derived from the final (PR4) Planck data release
- The Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: measurement of the BAO and growth rate of structure of the emission line galaxy sample from the anisotropic power spectrum between redshift 0.6 and 1.1
- Massive optimal data compression and density estimation for scalable, likelihood-free inference in cosmology
- Cosmological constraints with deep learning from KiDS-450 weak lensing maps
- KiDS-450: Cosmological Constraints from Weak Lensing Peak Statistics - II: Inference from Shear Peaks using N-body Simulations
- Beyond BAO: improving cosmological constraints from BOSS with measurement of the void-galaxy cross-correlation
- Probing Parity-Violation with the Four-Point Correlation Function of BOSS Galaxies
- Density split statistics: Cosmological constraints from counts and lensing in cells in DES Y1 and SDSS data
- Dark Energy Survey Year 1 Results: Galaxy-Galaxy Lensing
- Galaxy Power Spectrum Multipoles Covariance in Perturbation Theory
- Cosmological constraints from BOSS with analytic covariance matrices
- The VIMOS Public Extragalactic Redshift Survey: Measuring the growth rate of structure around cosmic voids
- 2D-FFTLog: Efficient computation of real space covariance matrices for galaxy clustering and weak lensing
- Measurement of Parity-Odd Modes in the Large-Scale 4-Point Correlation Function of SDSS BOSS DR12 CMASS and LOWZ Galaxies
- Unified galaxy power spectrum measurements from 6dFGS, BOSS, and eBOSS
- Baryonic effects for weak lensing. Part I. Power spectrum and covariance matrix
- Comparing approximate methods for mock catalogues and covariance matrices I: correlation function
- The 2-degree Field Lensing Survey: design and clustering measurements
- Looking through the same lens: shear calibration for LSST, Euclid & WFIRST with stage 4 CMB lensing
- Cosmological constraints from noisy convergence maps through deep learning
- The clustering of the SDSS-IV extended Baryon Oscillation Spectroscopic Survey DR14 quasar sample: anisotropic clustering analysis in configuration-space
- Cosmic Shear Cosmology Beyond 2-Point Statistics: A Combined Peak Count and Correlation Function Analysis of DES-Y1
- Cosmological Simulations for Combined-Probe Analyses: Covariance and Neighbour-Exclusion Bias
- The completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: geometry and growth from the anisotropic void-galaxy correlation function in the luminous red galaxy sample
- Bayesian optimisation for likelihood-free cosmological inference
- DESI 2024 V: Full-Shape Galaxy Clustering from Galaxies and Quasars
- Scientific Synergy Between LSST and Euclid
- Characterizing Signal Loss in the 21 cm Reionization Power Spectrum: A Revised Study of PAPER-64
- Accurate cosmic shear errors: do we need ensembles of simulations?
- The Redshift Space Momentum Power Spectrum II: measuring the growth rate from the combined 2MTF and 6dFGSv surveys
- Complete super-sample lensing covariance in the response approach
- Fewer Mocks and Less Noise: Reducing the Dimensionality of Cosmological Observables with Subspace Projections
- Perturbation theory approach to predict the covariance matrices of the galaxy power spectrum and bispectrum in redshift space
- Nuw CDM cosmology from the weak lensing convergence PDF
- Dark Energy Survey Year 3 results: cosmology with moments of weak lensing mass maps -- validation on simulations
- Full-Shape Galaxy Power Spectra and the Curvature Tension
- Massive data compression for parameter-dependent covariance matrices
- Optimizing large-scale structure data analysis with the theoretical error likelihood
- Cross-correlating Planck tSZ with RCSLenS weak lensing: Implications for cosmology and AGN feedback
- Cosmological Forecast for non-Gaussian Statistics in large-scale weak Lensing Surveys
- Cosmological Measurements from Angular Power Spectra Analysis of BOSS DR12 Tomography
- KiDS+2dFLenS+GAMA: Testing the cosmological model with the statistic
- Toward a robust inference method for the galaxy bispectrum: likelihood function and model selection
- Cosmic Shear Covariance Matrix in CDM: Cosmology Matters
- KiDS+GAMA: Constraints on Horndeski gravity from combined large-scale structure probes
- Colliding Ghosts: Constraining Inflation with the Parity-Odd Galaxy Four-Point Function
- Joint analysis of anisotropic power spectrum, bispectrum and trispectrum: application to N-body simulations
- Redshift-space distortions with split densities
- Cosmological parameters from the likelihood analysis of the galaxy power spectrum and bispectrum in real space
- On the insufficiency of arbitrarily precise covariance matrices: non-Gaussian weak lensing likelihoods
- Baryonic effects for weak lensing. Part II. Combination with X-ray data and extended cosmologies
- A Unified Analysis of Four Cosmic Shear Surveys
- New constraint on the tensor-to-scalar ratio from the and BICEP/Keck Array data using the profile likelihood
- Persistent homology in cosmic shear: constraining parameters with topological data analysis
- Approximate Bayesian Computation in Large Scale Structure: constraining the galaxy-halo connection
- Enhancing BOSS bispectrum cosmological constraints with maximal compression
- Matter trispectrum: theoretical modelling and comparison to N-body simulations
- Cosmological constraints with weak lensing peak counts and second-order statistics in a large-field survey
- The skewed weak lensing likelihood: why biases arise, despite data and theory being sound
- KiDS & Euclid: Cosmological implications of a pseudo angular power spectrum analysis of KiDS-1000 cosmic shear tomography
- Interpreting deep learning models for weak lensing
- Quantifying Tensions between CMB and Distance Datasets in Models with Free Curvature or Lensing Amplitude
- Quantifying lost information due to covariance matrix estimation in parameter inference
- Towards optimal cosmological parameter recovery from compressed bispectrum statistics
- CFHTLenS and RCSLenS Cross-Correlation with Planck Lensing Detected in Fourier and Configuration Space
- Cosmological constraints from the power spectrum of eBOSS quasars
- Revisiting CFHTLenS cosmic shear: Optimal E/B mode decomposition using COSEBIs and compressed COSEBIs
- Precision matrix expansion - efficient use of numerical simulations in estimating errors on cosmological parameters
- Non-linear shrinkage estimation of large-scale structure covariance
- Constraining cosmology with weak lensing voids
- KiDS-450: Tomographic Cross-Correlation of Galaxy Shear with {\it Planck} Lensing
- Probing dark energy with tomographic weak-lensing aperture mass statistics
- The Halo Bispectrum Multipoles in Redshift Space
- Creating Jackknife and Bootstrap estimates of the covariance matrix for the two-point correlation function
- Towards a self-consistent analysis of the anisotropic galaxy two- and three-point correlation functions on large scales: application to mock galaxy catalogues
- CosmoGridV1: a simulated CDM theory prediction for map-level cosmological inference
- Cross-correlation of weak lensing and gamma rays: implications for the nature of dark matter
- BAO from angular clustering: optimization and mitigation of theoretical systematics
- Likelihood Non-Gaussianity in Large-Scale Structure Analyses
- Scale dependence of galaxy biasing investigated by weak gravitational lensing: An assessment using semi-analytic galaxies and simulated lensing data
- Persistent homology in cosmic shear II: A tomographic analysis of DES-Y1
- ICE-COLA: fast simulations for weak lensing observables
- A new model to predict weak-lensing peak counts III. Filtering technique comparisons
- Do dark matter halos explain lensing peaks?
- Non-Linear Matter Power Spectrum Covariance Matrix Errors and Cosmological Parameter Uncertainties
- The Gravitational Lensing Signatures of BOSS Voids in the Cosmic Microwave Background
- Beyond two-point statistics: using the minimum spanning tree as a tool for cosmology
- Disconnected Covariance of 2-point Functions in Large-Scale Structure
- The clustering of the SDSS-IV extended Baryon Oscillation Spectroscopic Survey DR14 quasar sample: measuring the evolution of the growth rate using redshift space distortions between redshift 0.8 and 2.2
- On the accuracy and precision of correlation functions and field-level inference in cosmology
- Analytic Gaussian Covariance Matrices for Galaxy -Point Correlation Functions
- Using the cosmological recombination radiation to probe early dark energy and fundamental constant variations
- Estimating sparse precision matrices
- Interacting dark energy from the joint analysis of the power spectrum and bispectrum multipoles with the EFTofLSS
- BeyondPlanck I. Global Bayesian analysis of the Planck Low Frequency Instrument data
- Fast Generation of Covariance Matrices for Weak Lensing
- New constraints on cosmological modified gravity theories from anisotropic three-point correlation functions of BOSS DR12 galaxies
- KiDS-450: Enhancing cosmic shear with clipping transformations
- Covariance of the galaxy angular power spectrum with the halo model
- Combination of cluster number counts and two-point correlations: Validation on Mock Dark Energy Survey
- KiDS-1000 Cosmology: Constraints from density split statistics
- Non-Gaussianity in the Weak Lensing Correlation Function Likelihood -- Implications for Cosmological Parameter Biases
- A roadmap to cosmological parameter analysis with third-order shear statistics I: Modelling and validation
- PT challenge: Validation of ShapeFit on large-volume, high-resolution mocks
- A First Detection of the Connected 4-Point Correlation Function of Galaxies Using the BOSS CMASS Sample
- Quijote-PNG: Quasi-maximum likelihood estimation of Primordial Non-Gaussianity in the non-linear dark matter density field
- LiteBIRD Science Goals and Forecasts. A Case Study of the Origin of Primordial Gravitational Waves using Large-Scale CMB Polarization
- Debiasing inference with approximate covariance matrices and other unidentified biases
- Assessing Consistency Between WMAP 9-year and Planck 2015 Temperature Power Spectra
- Beyond Gaussian Noise: A Generalized Approach to Likelihood Analysis with non-Gaussian Noise
- A Bayesian method for combining theoretical and simulated covariance matrices for large-scale structure surveys
- A comparison between Shapefit compression and Full-Modelling method with PyBird for DESI 2024 and beyond
- Impact of baryons in cosmic shear analyses with tomographic aperture mass statistics
- Cosmological Inference from Galaxy-Clustering Power Spectrum: Gaussianization and Covariance Decomposition
- Cosmological Studies from HSC-SSP Tomographic Weak Lensing Peak Abundances
- Inadequacy of internal covariance estimation for super-sample covariance
- Primordial power spectrum and cosmology from black-box galaxy surveys
- Towards a full CDM map-based analysis for weak lensing surveys
- Squeezing out of the matter bispectrum with consistency relations
- BeyondPlanck XII. Cosmological parameter constraints with end-to-end error propagation
- Towards cosmological constraints from the compressed modal bispectrum: a robust comparison of real-space bispectrum estimators
- Extreme data compression while searching for new physics
- Hybrid-basis inference for large-scale galaxy clustering: combining spherical and Cartesian Fourier analyses
- Almanac: Weak Lensing power spectra and map inference on the masked sphere
- Variations of cosmic large-scale structure covariance matrices across parameter space
- A blinding solution for inference from astronomical data
- Fitting covariance matrix models to simulations
- Cosmological Parameter Estimation and Inference using Deep Summaries
- Flow-Based Likelihoods for Non-Gaussian Inference
- Indra: a Public Computationally Accessible Suite of Cosmological -body Simulations
- A joint 2- and 3-point clustering analysis of the VIPERS PDR2 catalogue at z~1: breaking the degeneracy of cosmological parameters
- Euclid: Covariance of weak lensing pseudo- estimates. Calculation, comparison to simulations, and dependence on survey geometry
- Galaxy blending effects in deep imaging cosmic shear probes of cosmology
- Parameter inference and model comparison using theoretical predictions from noisy simulations
- GEO-FPT: a model of the galaxy bispectrum at mildly non-linear scales
- A tomographic spherical mass map emulator of the KiDS-1000 survey using conditional generative adversarial networks
- The halo 3-point correlation function: a methodological analysis
- Almanac: MCMC-based signal extraction of power spectra and maps on the sphere
- Stage IV baryonic feedback correction for non-Gaussianity inference
- Multi-Component Decomposition of Cosmic Infrared Background Fluctuations
- Small scale clustering of BOSS galaxies: dependence on luminosity, color, age, stellar mass, specific star formation rate and other properties
- Cosmological inference including massive neutrinos from the matter power spectrum: biases induced by uncertainties in the covariance matrix
- DESI Mock Challenge: Constructing DESI galaxy catalogues based on FastPM simulations
- CFHTLenS: Galaxy bias as function of scale, stellar mass, and colour. Conflicts with predictions by semi-analytic models
- Bayesian error propagation for neural-net based parameter inference
- Faster cosmological analysis with power spectrum without simulations
- Reconstructing the epoch of reionisation with Planck PR4
- Galaxy and Mass Assembly (GAMA): Probing galaxy-group correlations in redshift space with the halo streaming model
- PoPE: A population-based approach to model spatial structure of astronomical systems
- Exploring HOD-dependent systematics for the DESI 2024 Full-Shape galaxy clustering analysis
- Simulation-based inference has its own Dodelson-Schneider effect (but it knows that it does)
- From few to many maps: A fast map-level emulator for extreme augmentation of CMB systematics datasets
- Euclid: Fast two-point correlation function covariance through linear construction
- Statistical Nuances in BAO Analysis: Likelihood Formulations and Non-Gaussianities
- Catalog-level blinding on the bispectrum for DESI-like galaxy surveys
- Combined -point analysis of the Cosmic Microwave Background and Large-Scale Structure: implications for the -tension and neutrino mass constraints
- Cosmological parameters from the joint analysis of Density Split and Second Order Statistics: an Emulator based on the Halo Occupation Distribution
- A comparison of shrinkage estimators of the cosmological precision matrix
- Model-independent constraints on clustering and growth of cosmic structures from BOSS DR12 galaxies in harmonic space
- Galaxy Clustering in Harmonic Space from the Dark Energy Survey Year 1 Data: Compatibility with Real-Space Results
- Cosmic shear beyond 2-point statistics: Accounting for galaxy intrinsic alignment with projected tidal fields
- Modeling and measuring the anisotropic halo 3-point correlation function: a coordinated study
- How to optimally combine pre-reconstruction full shape and post-reconstruction BAO signals
- Cosmological measurements from the CMB and BAO are insensitive to the tail probability in the assumed likelihood
- The Parameter-Level Performance of Covariance Matrix Conditioning in Cosmic Microwave Background Data Analyses
- Dark Energy Survey Year 3 results: Cosmology with peaks using an emulator approach
- Cosmic Shear in Harmonic Space from the Dark Energy Survey Year 1 Data: Compatibility with Configuration Space Results
- Non-Gaussian likelihood of weak lensing power spectra
- Origin & evolution of the Universe
- Bias on Tensor-to-Scalar Ratio Inference With Estimated Covariance Matrices
- Improving cosmological covariance matrices with machine learning
- Optimal data compression for Lyman- forest cosmology
- VLTI/MATISSE observations of the hot dust around Pictoris: Observing faint objects with MATISSE
- Matching Bayesian and frequentist coverage probabilities when using an approximate data covariance matrix