Analyzing Semantic Faithfulness of Language Models via Input Intervention on Question Answering

Akshay Chaturvedi, Swarnadeep Bhar, Soumadeep Saha +2

Transformer-based language models have been shown to be highly effective for several NLP tasks. In this paper, we consider three transformer models, BERT, RoBERTa, and XLNet, in bo…