Approximating Continuous Functions by ReLU Nets of Minimal Width

Boris Hanin, Mark Sellke

This article concerns the expressive power of depth in deep feed-forward neural nets with ReLU activations. Specifically, we answer the following question: for a fixed $d_{in}\geq…