23 citations · 40 across the 3 of their papers we have counts for
3 papers
stat.ML2021★ 3 cited
Saddle-to-Saddle Dynamics in Deep Linear Networks: Small Initialization Training, Symmetry, and Sparsity
Arthur Jacot, François Ged, Berfin Şimşek +2
The dynamics of Deep Linear Networks (DLNs) is dramatically affected by the variance of the parameters at initialization . For DLNs of width , we show a phase transit…
cs.LG2021★ 14 cited
Geometry of the Loss Landscape in Overparameterized Neural Networks: Symmetries and Invariances
Berfin Şimşek, François Ged, Arthur Jacot +4
We study how permutation symmetries in overparameterized multi-layer neural networks generate `symmetry-induced' critical points. Assuming a network with layers of minimal wi…
stat.ML2020★ 23 cited
Kernel Alignment Risk Estimator: Risk Prediction from Training Data
Arthur Jacot, Berfin Şimşek, Francesco Spadaro +2
We study the risk (i.e. generalization error) of Kernel Ridge Regression (KRR) for a kernel with ridge and i.i.d. observations. For this, we introduce two objects: the Si…