6 papers
Phases of Muon: When Muon Eclipses SignSGD
Elliot Paquette, Noah Marshall, Lucas Benigni +3
Recently, Muon and related spectral optimizers have demonstrated strong empirical performance as scalable stochastic methods, often outperforming Adam. Yet their behaviour remains…
The delocalization of eigenvectors of real elliptic matrices
Lucas Benigni, Simon Coste, Guillaume Dubach
We investigate delocalization phenomena for eigenvectors of real random matrices that are invariant by orthogonal transformations. A specific phenomenon with these ensembles is tha…
Hadamard product of independent random sample covariance matrices with correlation structure
Lucas Benigni, Ziyad Zaklani
We compute the asymptotic empirical eigenvalue distribution of the matrix where are i…
Convergence of local eigenvector processes of generalized Wigner matrices
Lucas Benigni, Mohammadreza Rezaei Feyzabady
We prove convergence of eigenvector processes of the form where is a bulk eigenvector of generali…
Eigenvalue distribution of the Neural Tangent Kernel in the quadratic scaling
Lucas Benigni, Elliot Paquette
We compute the asymptotic eigenvalue distribution of the neural tangent kernel of a two-layer neural network under a specific scaling of dimension. Namely, if $X\in\mathbb{R}^{n\ti…
Eigenvalue distribution of the Hadamard product of sample covariance matrices in a quadratic regime
Sebastien Abou Assaly, Lucas Benigni
In this note, we prove that if and are two independent matrices with i.i.d entries then the empirical spectral distributio…