Three Quantization Regimes for ReLU Networks

Weigutian Ou, Philipp Schenkel, Helmut Bölcskei

We establish the fundamental limits in the approximation of Lipschitz functions by deep ReLU neural networks with finite-precision weights. Specifically, three regimes, namely unde…