Implicit Hypersurface Approximation Capacity in Deep ReLU Networks

Jonatan Vallin, Karl Larsson, Mats G. Larson

We develop a geometric approximation theory for deep feed-forward neural networks with ReLU activations. Given a $d$-dimensional hypersurface in ${\mathbb{R}}^{d+1}$ represented as t…