A deep network construction that adapts to intrinsic dimensionality beyond the domain

Alexander Cloninger, Timo Klock

We study the approximation of two-layer compositions $f(x)=g(\varphi (x))$ via deep networks with ReLU activation, where $\varphi$ is a geometrically intuitive, dimensionality reducing featur…