1 citations · 1 across the 2 of their papers we have counts for
2 papers
cs.LG2024★ 1 cited
BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models
Qijun Luo, Hengxu Yu, Xiao Li
This work presents BAdam, an optimization method that leverages the block coordinate descent (BCD) framework with Adam's update rule. BAdam offers a memory efficient approach to th…
math.OC2023
High Probability Guarantees for Random Reshuffling
Hengxu Yu, Xiao Li
We consider the stochastic gradient method with random reshuffling () for tackling smooth nonconvex optimization problems. finds broad applications in pr…