66 citations · 228 across the 17 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
math.OC2024★ 1 cited
Tuning-Free Stochastic Optimization
Ahmed Khaled, Chi Jin
Large-scale machine learning problems make the cost of hyperparameter tuning ever more prohibitive. This creates a need for algorithms that can tune themselves on-the-fly. We forma…
cs.LG2024
Directional Smoothness and Gradient Methods: Convergence and Adaptivity
Aaron Mishkin, Ahmed Khaled, Yuanhao Wang +2
We develop new sub-optimality bounds for gradient descent (GD) that depend on the conditioning of the objective along the path of optimization rather than on global, worst-case con…