Robust Transfer Learning with Pretrained Language Models through Adapters

Wenjuan Han, Bo Pang, Yingnian Wu

Transfer learning with large pretrained transformer-based language models like BERT has become a dominating approach for most NLP tasks. Simply fine-tuning those large language mod…