The universal approximation power of finite-width deep ReLU networks

Dmytro Perekrestenko, Philipp Grohs, Dennis Elbrächter +1

We show that finite-width deep ReLU neural networks yield rate-distortion optimal approximation (Bölcskei et al., 2018) of polynomials, windowed sinusoidal functions, one-dimension…