Probing Pre-Trained Language Models for Disease Knowledge

Israa Alghanmi, Luis Espinosa-Anke, Steven Schockaert

Pre-trained language models such as ClinicalBERT have achieved impressive results on tasks such as medical Natural Language Inference. At first glance, this may suggest that these…