Approximation by Combinations of ReLU and Squared ReLU Ridge Functions with ${\ell }^1$ and ${\ell }^0$ Controls

Jason M. Klusowski, Andrew R. Barron

We establish $L^{\infty }$ and $L^2$ error bounds for functions of many variables that are approximated by linear combinations of ReLU (rectified linear unit) and squared ReLU r…