Minimal-Norm Univariate Two-Layer ReLU Classification: Exact Solutions and Global Optimality with Skip Connections

Karolina Drabik, Ben Lewis, Antoni Puch +4

We study minimal-norm interpolation and ${\ell }_2$-regularized logistic-loss minimization for binary classification by univariate two-layer ReLU networks. We give complete geometric…