21 citations · 43 across the 6 of their papers we have counts for
6 papers
On Robust Prefix-Tuning for Text Classification
Zonghan Yang, Yang Liu
Recently, prefix-tuning has gained increasing attention as a parameter-efficient finetuning method for large-scale pretrained language models. The method keeps the pretrained model…
Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Models
Ning Ding, Yujia Qin, Guang Yang +17
Despite the success, the process of fine-tuning large-scale PLMs brings prohibitive adaptation costs. In fact, fine-tuning all the parameters of a colossal model and retaining sepa…
Alternated Training with Synthetic and Authentic Data for Neural Machine Translation
Rui Jiao, Zonghan Yang, Maosong Sun +1
While synthetic bilingual corpora have demonstrated their effectiveness in low-resource neural machine translation (NMT), adding more synthetic data often deteriorates translation…
Neural Machine Translation: A Review of Methods, Resources, and Tools
Zhixing Tan, Shuo Wang, Zonghan Yang +4
Machine translation (MT) is an important sub-field of natural language processing that aims to translate natural languages using computers. In recent years, end-to-end neural machi…
Interpolation between Residual and Non-Residual Networks
Zonghan Yang, Yang Liu, Chenglong Bao +1
Although ordinary differential equations (ODEs) provide insights for designing network architectures, its relationship with the non-residual convolutional neural networks (CNNs) is…
Chinese Poetry Generation with a Working Memory Model
Xiaoyuan Yi, Maosong Sun, Ruoyu Li +1
As an exquisite and concise literary form, poetry is a gem of human culture. Automatic poetry generation is an essential step towards computer creativity. In recent years, several…