1.3k citations · 1.6k across the 25 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.LG2023★ 2 cited
Bottleneck Structure in Learned Features: Low-Dimension vs Regularity Tradeoff
Arthur Jacot
Previous work has shown that DNNs with large depth and -regularization are biased towards learning low-dimensional representations of the inputs, which can be interprete…
cs.LG2023★ 1 cited
Implicit bias of SGD in -regularized linear DNNs: One-way jumps from high to low rank
Zihan Wang, Arthur Jacot
The -regularized loss of Deep Linear Networks (DLNs) with more than one hidden layers has multiple local minima, corresponding to matrices with different ranks. In tasks suc…