Best k-layer neural network approximations

Lek-Heng Lim, Mateusz Michalek, Yang Qi

We show that the empirical risk minimization (ERM) problem for neural networks has no solution in general. Given a training set $s_1,\dots ,s_n\in {\mathbb{R}}^p$ with correspondin…