Generalization in the Face of Adaptivity: A Bayesian Perspective

Moshe Shenfeld, Katrina Ligett

Repeated use of a data sample via adaptively chosen queries can rapidly lead to overfitting, wherein the empirical evaluation of queries on the sample significantly deviates from t…