Position: A Theory of Deep Learning Must Include Compositional Sparsity

David A. Danhofer, Davide D'Ascenzo, Rafael Dubach +1

Overparametrized Deep Neural Networks (DNNs) have demonstrated remarkable success in a wide variety of domains too high-dimensional for classical shallow networks subject to the cu…