Robust Fine-tuning via Perturbation and Interpolation from In-batch Instances

Shoujie Tong, Qingxiu Dong, Damai Dai +4

Fine-tuning pretrained language models (PLMs) on downstream tasks has become common practice in natural language processing. However, most of the PLMs are vulnerable, e.g., they ar…