21 citations · 25 across the 2 of their papers we have counts for
2 papers
cs.CL2022★ 21 cited
Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Models
Ning Ding, Yujia Qin, Guang Yang +17
Despite the success, the process of fine-tuning large-scale PLMs brings prohibitive adaptation costs. In fact, fine-tuning all the parameters of a colossal model and retaining sepa…
cs.LG2021★ 4 cited
Stochastic Anderson Mixing for Nonconvex Stochastic Optimization
Fuchao Wei, Chenglong Bao, Yang Liu
Anderson mixing (AM) is an acceleration method for fixed-point iterations. Despite its success and wide usage in scientific computing, the convergence theory of AM remains unclear,…