Temporal Entailment Pretraining for Clinical Language Models over EHR Data

Tatsunori Tanaka, Fi Zheng, Kai Sato +3

Clinical language models have achieved strong performance on downstream tasks by pretraining on domain specific corpora such as discharge summaries and medical notes. However, most…