When BERT Fails -- The Limits of EHR Classification

Augusto Garcia-Agundez, Carsten Eickhoff

Transformers are powerful text representation learners, useful for all kinds of clinical decision support tasks. Although they outperform baselines on readmission prediction, they…