2 citations · 9 across the 32 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.LG2023
Accelerated Convergence of Stochastic Heavy Ball Method under Anisotropic Gradient Noise
Rui Pan, Yuxing Liu, Xiaoyu Wang +1
Heavy-ball momentum with decaying learning rates is widely used with SGD for optimizing deep learning models. In contrast to its empirical popularity, the understanding of its theo…
cs.LG2023★ 2 cited
Plum: Prompt Learning using Metaheuristic
Rui Pan, Shuo Xing, Shizhe Diao +6
Since the emergence of large language models, prompt learning has become a popular method for optimizing and customizing these models. Special prompts, such as Chain-of-Thought, ha…