Learning Sparse Compositional Functions with Norm-Constrained Neural Networks

Shuo Huang, Lorenzo Fiorito, Lorenzo Rosasco +1

The ability of deep neural networks to learn hierarchical features is widely regarded as a key mechanism underlying their success in high-dimensional learning. Existing theory part…