A Pairwise Probe for Understanding BERT Fine-Tuning on Machine Reading Comprehension

Jie Cai, Zhengzhou Zhu, Ping Nie +1

Pre-trained models have brought significant improvements to many NLP tasks and have been extensively analyzed. But little is known about the effect of fine-tuning on specific tasks…