On the Efficiency of ERM in Feature Learning

Ayoub El Hanchi, Chris J. Maddison, Murat A. Erdogdu

Given a collection of feature maps indexed by a set $\mathcal{T}$, we study the performance of empirical risk minimization (ERM) on regression problems with square loss over the un…