Suboptimality of Penalized Empirical Risk Minimization in Classification

Guillaume Lecué

Let $\cF$ be a set of $M$ classification procedures with values in $[-1,1]$. Given a loss function, we want to construct a procedure which mimics at the best possible rate the best…