Fisher, Neyman-Pearson or NHST? A Tutorial for Teaching Data Testing

Abstract

Despite frequent calls for the overhaul of null hypothesis significance testing (NHST), this controversial procedure remains ubiquitous in behavioral, social and biomedical teaching and research. Little change seems possible once the procedure becomes well ingrained in the minds and current practice of researchers; thus, the optimal opportunity for such change is at the time the procedure is taught, be this at undergraduate or at postgraduate levels. This paper presents a tutorial for the teaching of data testing procedures, often referred to as hypothesis testing theories. The first procedure introduced is the approach to data testing followed by Fisher (tests of significance); the second is the approach followed by Neyman and Pearson (tests of acceptance); the final procedure is the incongruent combination of the previous two theories into the current approach (NSHT). For those researchers sticking with the latter, two compromise solutions on how to improve NHST conclude the tutorial.

21 pages, 5 figures, published article. Frontiers in Psychology, 6:223

Cited by in corpus (6)

• Divergence vs. Decision P-values: A Distinction Worth Making in Theory and Keeping in Practice
• Can visualization alleviate dichotomous thinking? Effects of visual representations on the cliff effect
• Neyman-Pearson Hypothesis Testing, Epistemic Reliability and Pragmatic Value-Laden Asymmetric Error Risks
• Hypothesis-based acceptance sampling for modules F and F1 of the European Measuring Instruments Directive
• A fuzzy take on the logical issues of statistical hypothesis testing
• Decision Making in Drug Development via Inference on Power