555 citations · 2.5k across the 105 of their papers we have counts for
Showing 2023 · math.OCShow all
2 papers · 2 filters
math.OC2023★ 4 cited
Convex and Non-convex Optimization Under Generalized Smoothness
Haochuan Li, Jian Qian, Yi Tian +2
Classical analysis of convex and non-convex optimization methods often requires the Lipshitzness of the gradient, which limits the analysis to functions bounded by quadratics. Rece…
math.OC2023★ 5 cited
Convergence of Adam Under Relaxed Assumptions
Haochuan Li, Alexander Rakhlin, Ali Jadbabaie
In this paper, we provide a rigorous proof of convergence of the Adaptive Moment Estimate (Adam) algorithm for a wide class of optimization objectives. Despite the popularity and e…