On the Variance, Admissibility, and Stability of Empirical Risk Minimization

Gil Kur, Eli Putterman, Alexander Rakhlin

It is well known that Empirical Risk Minimization (ERM) may attain minimax suboptimal rates in terms of the mean squared error (Birgé and Massart, 1993). In this paper, we prove t…