From Approximation Rates to Loss-Landscape Barrier Decay in Shallow ReLU Networks

Saveliy Baturin

We study pathwise connectivity of sublevel sets for one-hidden-layer ReLU networks with constrained first-layer weights and an ${\ell }_1$ penalty on the output layer. The data term i…