2 citations · 2 across the 11 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.LG2024
AdaGrad under Anisotropic Smoothness
Yuxing Liu, Rui Pan, Tong Zhang
Adaptive gradient methods have been widely adopted in training large-scale deep neural networks, especially large foundation models. Despite the huge success in practice, their the…
math.OC2024
On the Complexity of Finite-Sum Smooth Optimization under the Polyak-Łojasiewicz Condition
Yunyan Bai, Yuxing Liu, Luo Luo
This paper considers the optimization problem of the form , where satisfies the…