31 citations · 88 across the 18 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.LG2024
Simplicity bias and optimization threshold in two-layer ReLU networks
Etienne Boursier, Nicolas Flammarion
Understanding generalization of overparametrized neural networks remains a fundamental challenge in machine learning. Most of the literature mostly studies generalization from an i…
cs.LG2024
Early alignment in two-layer networks training is a two-edged sword
Etienne Boursier, Nicolas Flammarion
Training neural networks with first order optimisation methods is at the core of the empirical success of deep learning. The scale of initialisation is a crucial factor, as small i…