1 citations · 3 across the 14 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.LG2023
PAC-tuning:Fine-tuning Pretrained Language Models with PAC-driven Perturbed Gradient Descent
Guangliang Liu, Zhiyu Xue, Xitong Zhang +2
Fine-tuning pretrained language models (PLMs) for downstream tasks is a large-scale optimization problem, in which the choice of the training algorithm critically determines how we…
stat.ML2023★ 1 cited
Improving Generalization of Complex Models under Unbounded Loss Using PAC-Bayes Bounds
Xitong Zhang, Avrajit Ghosh, Guangliang Liu +1
Previous research on PAC-Bayes learning theory has focused extensively on establishing tight upper bounds for test errors. A recently proposed training procedure called PAC-Bayes t…