Optimal Nonlinearities Improve Generalization Performance of Random Features

Samet Demir, Zafer Doğan

Random feature model with a nonlinear activation function has been shown to perform asymptotically equivalent to a Gaussian model in terms of training and generalization errors. An…