Frequentist and Bayesian Confidence Intervals

Abstract

Frequentist (classical) and the Bayesian approaches to the construction of confidence limits are compared. Various examples which illustrate specific problems are presented. The Likelihood Principle and the Stopping Rule Paradox are discussed. The performance of the different methods is investigated relative to the properties coherence, precision, bias, universality, simplicity. A proposal on how to define error limits in various cases are derived from the comparison. They are based on the likelihood function only and follow in most cases the general practice in high energy physics. Classical methods are not recommended because they violate the Likelihood Principle, they can produce physically inconsistent results, suffer from lack of precision and generality. Also the extreme Bayesian approach with arbitrary choice of the prior probability density or priors deduced from scaling laws is rejected.

64 pages, 26 figures

References in corpus (5)

• A Unified Approach to the Classical Statistical Analysis of Small Signals
• Limits on the Majorana neutrino mass in the 0.1 eV range
• Improved Probability Method for Estimating Signal in the Presence of Background
• A new ordering principle for the classical statistical analysis of Poisson processes with background
• Incorporation of the statistical uncertainty in the background estimate into the upper limit on the signal