Why Deep Neural Networks for Function Approximation?

Shiyu Liang, R. Srikant

Recently there has been much interest in understanding why deep neural networks are preferred to shallow networks. We show that, for a large class of piecewise smooth functions, th…