Logically-consistent hypothesis testing in the hexagon of oppositions

Abstract

Although logical consistency is desirable in scientific research, standard statistical hypothesis tests are typically logically inconsistent. In order to address this issue, previous work introduced agnostic hypothesis tests and proved that they can be logically consistent while retaining statistical optimality properties. This paper characterizes the credal modalities in agnostic hypothesis tests and uses the hexagon of oppositions to explain the logical relations between these modalities. Geometric solids that are composed of hexagons of oppositions illustrate the conditions for these modalities to be logically consistent. Prisms composed of hexagons of oppositions show how the credal modalities obtained from two agnostic tests vary according to their threshold values. Nested hexagons of oppositions summarize logical relations between the credal modalities in these tests and prove new relations.

arXiv comment25 pages, 9 figures

Cited by in corpus (6)

• Pragmatic hypotheses in the evolution of science
• Interpretable hypothesis tests
• The e-value: A Fully Bayesian Significance Measure for Precise Statistical Hypotheses and its Research Program
• A Sharper Image: The Quest of Science and Recursive Production of Objective Realities
• A fuzzy take on the logical issues of statistical hypothesis testing
• Karl Pearson and the Logic of Science: Renouncing Causal Understanding (the Bride) and Inverted Spinozism