2 papers
cs.LG2026
Faster Adaptive Optimization via Expected Gradient Outer Product Reparameterization
Adela DePavia, Jose Cruzado, Jiayou Liang +2
Adaptive optimization algorithms -- such as Adagrad, Adam, and their variants -- have found widespread use in machine learning, signal processing and many other settings. Several m…
cs.LG2025
How do simple rotations affect the implicit bias of Adam?
Adela DePavia, Vasileios Charisopoulos, Rebecca Willett
Adaptive gradient methods such as Adam and Adagrad are widely used in machine learning, yet their effect on the generalization of learned models -- relative to methods like gradien…