Approximation capabilities of neural networks on unbounded domains

Ming-Xi Wang, Yang Qu

In this paper, we prove that a shallow neural network with a monotone sigmoid, ReLU, ELU, Softplus, or LeakyReLU activation function can arbitrarily well approximate any L^p(p>=2)…