most citedNext-token prediction capacity: general upper bounds and a lower bound for transformers

1 citations · 1 across the 2 of their papers we have counts for

collaborators
Showing math.OCShow all

1 paper · 1 filter

math.OC2025

Glocal Smoothness: Line search and adaptive step sizes can help in theory too!

Curtis Fox, Aaron Mishkin, Sharan Vaswani +1

Iteration complexities for optimizing smooth functions with first-order algorithms are typically stated in terms of a global Lipschitz constant of the gradient, and near-optimal re…