Comparing Bayes factors and hierarchical inference for testing general relativity with gravitational waves

Abstract

In the context of testing general relativity with gravitational waves, constraints obtained with multiple events are typically combined either through a hierarchical formalism or though a combined multiplicative Bayes factor. We show that the well-known dependence of Bayes factors on the analysis priors in regions of the parameter space without likelihood support can lead to strong confidence in favor of incorrect conclusions when one employs the multiplicative Bayes factor. Bayes factors $\mathcal{O}(1)$ are ambivalent as they depend sensitively on the analysis priors, which are rarely set in a principled way; additionally, combined Bayes factors $>\mathcal{O}(10^3)$ can be obtained in favor of the incorrect conclusion depending on the analysis priors when many $\mathcal{O}(1)$ Bayes factors are multiplied, and specifically when the priors are much wider than the underlying population. The hierarchical analysis that instead infers the ensemble distribution of the individual beyond-general-relativity constraints does not suffer from this problem, and generically converges to favor the correct conclusion. Rather than a naive multiplication, a more reliable Bayes factor can be computed from the hierarchical analysis. We present a number of toy models showing that the practice of multiplying Bayes Factors can lead to incorrect conclusions.

References in corpus (13)

• Advanced Virgo: a 2nd generation interferometric gravitational wave detector
• BayesWave: Bayesian Inference for Gravitational Wave Bursts and Instrument Glitches
• The BayesWave analysis pipeline in the era of gravitational wave observations
• Probing the non-linear structure of general relativity with black hole binaries
• Testing the no-hair theorem with black hole ringdowns using TIGER
• Thanks for the memory: measuring gravitational-wave memory in the first LIGO/Virgo gravitational-wave transient catalog
• On combining information from multiple gravitational wave sources
• Assigning confidence to inspiral gravitational wave candidates with Bayesian model selection
• Are Parametrized Tests of General Relativity with Gravitational Waves Robust to Unknown Higher Post-Newtonian Order Effects?
• Black hole spectroscopy horizons for current and future gravitational wave detectors
• Quantum black hole spectroscopy: probing the quantum nature of the black hole area using LIGO-Virgo ringdown detections
• Population inference of spin-induced quadrupole moments as a probe for non-black hole compact binaries
• Gravitational wave detection without boot straps: a Bayesian approach