Does QA-based intermediate training help fine-tuning language models for text classification?

Shiwei Zhang, Xiuzhen Zhang

Fine-tuning pre-trained language models for downstream tasks has become a norm for NLP. Recently it is found that intermediate training based on high-level inference tasks such as…