How to combine correlated data sets -- A Bayesian hyperparameter matrix method

Abstract

We construct a "hyperparameter matrix" statistical method for performing the joint analyses of multiple correlated astronomical data sets, in which the weights of data sets are determined by their own statistical properties. This method is a generalization of the hyperparameter method constructed by Lahav et al. (2000) and Hobson, Bridle, & Lahav (2002) which was designed to combine independent data sets. The advantage of our method is to treat correlations between multiple data sets and gives appropriate relevant weights of multiple data sets with mutual correlations. We define a new "element-wise" product, which greatly simplifies the likelihood function with hyperparameter matrix. We rigorously prove the simplified formula of the joint likelihood and show that it recovers the original hyperparameter method in the limit of no covariance between data sets. We then illustrate the method by applying it to a demonstrative toy model of fitting a straight line to two sets of data. We show that the hyperparameter matrix method can detect unaccounted systematic errors or underestimated errors in the data sets. Additionally, the ratio of Bayes' factors provides a distinct indicator of the necessity of including hyperparameters. Our example shows that the likelihood we construct for joint analyses of correlated data sets can be widely applied to many astrophysical systems.

13 pages, 7 figures. Astronomy and Computing, 2014

References in corpus (7)

• Nine-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Cosmological Parameter Results
• The Atacama Cosmology Telescope: Cosmological parameters from three seasons of data
• The 6dF Galaxy Survey: The Near-Infrared Fundamental Plane of Early-Type Galaxies
• Cosmic bulk flows on 50 {h}^{-1}Mpc scales: A Bayesian hyper-parameter method and multishells likelihood analysis
• Constraints on standard and non-standard early Universe models from CMB B-mode polarization
• A comparison of the galaxy peculiar velocity field with the PSCz gravity field-- A Bayesian hyper-parameter method
• Constraints on single-field inflation with WMAP, SPT and ACT data -- A last-minute stand before Planck

Cited by in corpus (6)

• The 6dF Galaxy Velocity Survey: Cosmological constraints from the velocity power spectrum
• Conservative cosmology: combining data with allowance for unknown systematics
• The SLUGGS Survey: The Inner Dark Matter Density Slope of the Massive Elliptical Galaxy NGC 1407
• Hybrid-basis inference for large-scale galaxy clustering: combining spherical and Cartesian Fourier analyses
• Sunyaev--Zel'dovich profile fitting with joint AMI-Planck analysis
• Physical modelling of galaxy clusters and Bayesian inference in astrophysics