A comparison of deep networks with ReLU activation function and linear spline-type methods

Konstantin Eckle, Johannes Schmidt-Hieber

Deep neural networks (DNNs) generate much richer function spaces than shallow networks. Since the function spaces induced by shallow networks have several approximation theoretic d…