The Generic Holdout: Preventing False-Discoveries in Adaptive Data Science

Preetum Nakkiran, Jarosław Błasiok

Adaptive data analysis has posed a challenge to science due to its ability to generate false hypotheses on moderately large data sets. In general, with non-adaptive data analyses (…