Sobolev Approximation of Deep ReLU Networks in Log-Barron Space

Changhoon Song, Seungchan Ko, Youngjoon Hong

Universal approximation theorems show that neural networks can approximate any continuous function; however, the number of parameters may grow exponentially with the ambient dimens…