The statistical significance filter leads to overconfident expectations of replicability

Shravan Vasishth, Andrew Gelman

We show that publishing results using the statistical significance filter---publishing only when the p-value is less than 0.05---leads to a vicious cycle of overoptimistic expectat…