How to Tell When a Result Will Replicate: Significance and Replication in Distributional Null Hypothesis Tests

Fintan Costello, Paul Watts

There is a well-known problem in Null Hypothesis Significance Testing: many statistically significant results fail to replicate in subsequent experiments. We show that this problem…