An in-depth look at approximation via deep and narrow neural networks

Joris Dommel, Sven A. Wegner

In 2017, Hanin and Sellke showed that the class of arbitrarily deep, real-valued, feed-forward and ReLU-activated networks of width w forms a dense subset of the space of continuou…