13 citations · 15 across the 9 of their papers we have counts for
1 paper · 2 filters
Yiheng Zhang, Shaowu Wu, Yuanzhuo Xu +4
Adaptive optimizers such as Adam have achieved great success in training large-scale models like large language models and diffusion models. However, they often generalize worse th…