Analysis of One-Hidden-Layer Neural Networks via the Resolvent Method

Vanessa Piccolo, Dominik Schröder

In this work, we investigate the asymptotic spectral density of the random feature matrix $M=Y{Y}^{\ast }$ with $Y=f(WX)$ generated by a single-hidden-layer neural network, where $…