Significance Tests in Climate Science
arXiv:1003.2934 · doi:10.1175/2010JCLI3746.1
Abstract
A large fraction of papers in the climate literature includes erroneous uses of significance tests. A Bayesian analysis is presented to highlight the meaning of significance tests and why typical misuse occurs. It is concluded that a significance test very rarely provides useful quantitative information. The significance statistic is not a quantitative measure of how confident we can be of the 'reality' of a given result.
arXiv comment9 pages