Optimal rates of approximation by shallow ReLU${}^k$ neural networks and applications to nonparametric regression

Yunfei Yang, Ding-Xuan Zhou

We study the approximation capacity of some variation spaces corresponding to shallow ReLU${}^k$ neural networks. It is shown that sufficiently smooth functions are contained in thes…