Nonparametric regression with modified ReLU networks

Aleksandr Beknazaryan, Hailin Sang

We consider regression estimation with modified ReLU neural networks in which network weight matrices are first modified by a function $\alpha$ before being multiplied by input vectors.…