On the Birnbaum Argument for the Strong Likelihood Principle

Abstract

An essential component of inference based on familiar frequentist notions, such as $p$-values, significance and confidence levels, is the relevant sampling distribution. This feature results in violations of a principle known as the strong likelihood principle (SLP), the focus of this paper. In particular, if outcomes ${\mathbf{x}}^{\ast }$ and ${\mathbf{y}}^{\ast }$ from experiments $E_1$ and $E_2$ (both with unknown parameter $\theta$) have different probability models $f_1(\cdot ),f_2(\cdot )$, then even though $f_1({\mathbf{x}}^{\ast };\theta )=c{f}_2({\mathbf{y}}^{\ast };\theta )$ for all $\theta$, outcomes ${\mathbf{x}}^{\ast }$ and ${\mathbf{y}}^{\ast }$ may have different implications for an inference about $\theta$. Although such violations stem from considering outcomes other than the one observed, we argue this does not require us to consider experiments other than the one performed to produce the data. David Cox [Ann. Math. Statist. 29 (1958) 357-372] proposes the Weak Conditionality Principle (WCP) to justify restricting the space of relevant repetitions. The WCP says that once it is known which $E_i$ produced the measurement, the assessment should be in terms of the properties of $E_i$. The surprising upshot of Allan Birnbaum's [J. Amer. Statist. Assoc. 57 (1962) 269-306] argument is that the SLP appears to follow from applying the WCP in the case of mixtures, and so uncontroversial a principle as sufficiency (SP). But this would preclude the use of sampling distributions. The goal of this article is to provide a new clarification and critique of Birnbaum's argument. Although his argument purports that [(WCP and SP) entails SLP], we show how data may violate the SLP while holding both the WCP and SP. Such cases also refute [WCP entails SLP].

Published in at http://dx.doi.org/10.1214/13-STS457 the Statistical Science (http://www.imstat.org/sts/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (1)

• Frequentist statistics as a theory of inductive inference

Cited by in corpus (11)

• Does preregistration improve the credibility of research findings?
• False confidence, non-additive beliefs, and valid statistical inference
• Type I Error Rates are Not Usually Inflated
• Lectures on Statistics in Theory: Prelude to Statistics in Practice
• On Bayesian Sequential Clinical Trial Designs
• Modification of Bayesian Updating where Continuous Parameters have Differing Relationships with New and Existing Data
• Discussion of "On the Birnbaum Argument for the Strong Likelihood Principle"
• Preregistration does not improve the transparent evaluation of severity in Popper's philosophy of science or when deviations are allowed
• A note on recent criticisms to Birnbaum's theorem
• Decades of Jurimetrics
• The likelihood principle does not entail a `sure thing', `evil demon' or `determinist' hypothesis