Convergence of Shallow ReLU Networks on Weakly Interacting Data

Léo Dana, Francis Bach, Loucas Pillaud-Vivien

We analyse the convergence of one-hidden-layer ReLU networks trained by gradient flow on $n$ data points. Our main contribution leverages the high dimensionality of the ambient spa…