Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Mind the Drift: Diagonal Linear Networks Under Large Learning Rates
Aniket Sanyal, Tom Jacobs, Rebekka Burkholz
Large learning rates can qualitatively change the trajectory of neural network training, often pushing optimization into regimes far from classical gradient-flow behavior. The Edge…
cs.LG2026
Frequency-Based Hyperparameter Selection in Games
Aniket Sanyal, Baraah A. M. Sidahmed, Rebekka Burkholz +1
Learning in smooth games fundamentally differs from standard minimization due to rotational dynamics, which invalidate classical hyperparameter tuning strategies. Despite their pra…