How BERT Speaks Shakespearean English? Evaluating Historical Bias in Contextual Language Models

Miriam Cuscito, Alfio Ferrara, Martin Ruskov

In this paper, we explore the idea of analysing the historical bias of contextual language models based on BERT by measuring their adequacy with respect to Early Modern (EME) and M…