3 papers
cs.LG2026
Mind the Drift: Diagonal Linear Networks Under Large Learning Rates
Aniket Sanyal, Tom Jacobs, Rebekka Burkholz
Large learning rates can qualitatively change the trajectory of neural network training, often pushing optimization into regimes far from classical gradient-flow behavior. The Edge…
cs.LG2026
Frequency-Based Hyperparameter Selection in Games
Aniket Sanyal, Baraah A. M. Sidahmed, Rebekka Burkholz +1
Learning in smooth games fundamentally differs from standard minimization due to rotational dynamics, which invalidate classical hyperparameter tuning strategies. Despite their pra…
math.OC2025
Understanding Lookahead Dynamics Through Laplace Transform
Aniket Sanyal, Tatjana Chavdarova
We introduce a frequency-domain framework for convergence analysis of hyperparameters in game optimization, leveraging High-Resolution Differential Equations (HRDEs) and Laplace tr…