AD-DROP: Attribution-Driven Dropout for Robust Language Model Fine-Tuning

Tao Yang, Jinghao Deng, Xiaojun Quan +2

Fine-tuning large pre-trained language models on downstream tasks is apt to suffer from overfitting when limited training data is available. While dropout proves to be an effective…