Preferred, Not Safer: Pairwise Preference Is a Poor Proxy for Clinical Safety

Fay Elhassan, David Sasu, Alexandra Kulinkina +2

We evaluate whether clinician pairwise preferences provide a reliable signal of clinical safety in large language model (LLM) evaluation using expert feedback from MOOVE (Massive O…