Depth Separation for Neural Networks under Gaussian Measure

Cynthia Bortolotto, Francisco Ganacim, Roberto I. Oliveira

We revisit the problem of depth separation for neural networks, as studied by Eldan and Shamir, Daniely, and others. Specifically, we consider the natural setting of $L^2$ approxim…