Showing cs.LGShow all
2 papers · 1 filter
cs.LG2025
Phase Diagram of Dropout for Two-Layer Neural Networks in the Mean-Field Regime
Lénaïc Chizat, Pierre Marion, Yerkin Yesbay
Dropout is a standard training technique for neural networks that consists of randomly deactivating units at each step of their gradient-based training. It is known to improve perf…
cs.LG2025
The Hidden Width of Deep ResNets: Tight Error Bounds and Phase Diagram
Lénaïc Chizat
We study the gradient-based training of large-depth residual networks (ResNets) from standard random initializations. We show that infinite-depth ResNets behave as if they were inf…