Constructive Universal Approximation and Finite Sample Memorization by Narrow Deep ReLU Networks

Martín Hernández, Enrique Zuazua

We present a fully constructive analysis of deep ReLU neural networks for classification and function approximation tasks. First, we prove that any dataset with $N$ distinct points…