activity
20232025
most citedThe High Line: Exact Risk and Learning Rate Curves of Stochastic Adaptive Learning Rate Algorithms

1 citations · 1 across the 4 of their papers we have counts for

collaborators
Showing 2023 · math.OCShow all

1 paper · 2 filters

math.OC2023

Hitting the High-Dimensional Notes: An ODE for SGD learning dynamics on GLMs and multi-index models

Elizabeth Collins-Woodfin, Courtney Paquette, Elliot Paquette +1

We analyze the dynamics of streaming stochastic gradient descent (SGD) in the high-dimensional limit when applied to generalized linear models and multi-index models (e.g. logistic…