A Random Matrix Approach to Neural Networks

Cosme Louart, Zhenyu Liao, Romain Couillet

This article studies the Gram random matrix model $G=\frac{1}{T}{\Sigma }^{\mathrm{T}}\Sigma$, $\Sigma =\sigma (WX)$, classically found in the analysis of random feature maps and random neural networks, where $X=[x…