On the term "randomization test"

Abstract

There exists no consensus on the meaning of the term "randomization test". Contradicting uses of the term are leading to confusion, misunderstandings and indeed invalid data analyses. As we point out, a main source of the confusion is that the term was not explicitly defined when it was first used in the 1930's. Later authors made clear proposals to reach a consensus regarding the term. This resulted in some level of agreement around the 1970's. However, in the last few decades, the term has often been used in ways that contradict these proposals. This paper provides an overview of the history of the term per se, for the first time tracing it back to 1937. This will hopefully lead to more agreement on terminology and less confusion on the related fundamental concepts.

References in corpus (8)

• Can parametric statistical methods be trusted for fMRI based group studies?
• Exact testing with random permutations
• Permutation-based simultaneous confidence bounds for the false discovery proportion
• Randomization Tests for Weak Null Hypotheses in Randomized Experiments
• Robust testing in generalized linear models by sign-flipping score contributions
• Another look at the Lady Tasting Tea and differences between permutation tests and randomization tests
• What is a randomization test?
• Notip: Non-parametric True Discovery Proportion control for brain imaging