On Sparsity in Overparametrised Shallow ReLU Networks

Jaume de Dios, Joan Bruna

The analysis of neural network training beyond their linearization regime remains an outstanding open question, even in the simplest setup of a single hidden-layer. The limit of in…