Pretraining EHR Foundation Models with Patient-Aware Sampling

Joshua Placidi, Yuxuan Liu, Jinpei Han +2

Autoregressive foundation models for electronic health records (EHRs) typically inherit pretraining methods from language modeling, where patient trajectories are concatenated into…