Bag of Lies: Robustness in Continuous Pre-training BERT

Ine Gevers, Walter Daelemans

This study aims to acquire more insights into the continuous pre-training phase of BERT regarding entity knowledge, using the COVID-19 pandemic as a case study. Since the pandemic…