paper

A Not-So-Fundamental Limitation on Studying Complex Systems with Statistics: Comment on Rabin (2011)

arXiv:1204.6096 · doi:10.1007/s10955-012-0647-y

Abstract

Although living organisms are affected by many interrelated and unidentified variables, this complexity does not automatically impose a fundamental limitation on statistical inference. Nor need one invoke such complexity as an explanation of the "Truth Wears Off" or "decline" effect; similar "decline" effects occur with far simpler systems studied in physics. Selective reporting and publication bias, and scientists' biases in favour of reporting eye-catching results (in general) or conforming to others' results (in physics) better explain this feature of the "Truth Wears Off" effect than Rabin's suggested limitation on statistical inference.

arXiv comment4 pages, no figures, 11 references. Commentary on Y. Rabin, Journal of Statistical Physics, 144, 213-216 (2011)