Robust and Resource Efficient Identification of Two Hidden Layer Neural Networks

Massimo Fornasier, Timo Klock, Michael Rauchensteiner

We address the structure identification and the uniform approximation of two fully nonlinear layer neural networks of the type $f(x)=1^{T}h(B^{T}g(A^{T}x))$ on ${\mathbb{R}}^d$ from a sm…