Efficient Adversarial Training with Robust Early-Bird Tickets

Zhiheng Xi, Rui Zheng, Tao Gui +2

Adversarial training is one of the most powerful methods to improve the robustness of pre-trained language models (PLMs). However, this approach is typically more expensive than tr…