What needles do sparse neural networks find in nonlinear haystacks

Sylvain Sardy, Nicolas W Hengartner, Nikolai Bonenko +1

Using a sparsity inducing penalty in artificial neural networks (ANNs) avoids over-fitting, especially in situations where noise is high and the training set is small in comparison…