Minimum Width of Leaky-ReLU Neural Networks for Uniform Universal Approximation

Li'ang Li, Yifei Duan, Guanghua Ji +1

The study of universal approximation properties (UAP) for neural networks (NN) has a long history. When the network width is unlimited, only a single hidden layer is sufficient for…