Deep Neural Networks with ReLU-Sine-Exponential Activations Break Curse of Dimensionality in Approximation on Hölder Class

Yuling Jiao, Yanming Lai, Xiliang Lu +3

In this paper, we construct neural networks with ReLU, sine and $2^x$ as activation functions. For general continuous $f$ defined on $[0,1{]}^d$ with continuity modulus ${\omega }_f(\cdot )$,…