Nonconvex regularization for sparse neural networks

Konstantin Pieper, Armenak Petrosyan

Convex ${\ell }_1$ regularization using an infinite dictionary of neurons has been suggested for constructing neural networks with desired approximation guarantees, but can be affecte…