17 citations · 17 across the 1 of their papers we have counts for
2 papers
stat.ML2020
Implicit Regularization of Random Feature Models
Arthur Jacot, Berfin Şimşek, Francesco Spadaro +2
Random Feature (RF) models are used as efficient parametric approximations of kernel methods. We investigate, by means of random matrix theory, the connection between Gaussian RF m…
cs.LG2019★ 17 cited
Weight-space symmetry in deep networks gives rise to permutation saddles, connected by equal-loss valleys across the loss landscape
Johanni Brea, Berfin Simsek, Bernd Illing +1
The permutation symmetry of neurons in each layer of a deep neural network gives rise not only to multiple equivalent global minima of the loss function, but also to first-order sa…