A rubric-based controlled comparison of frontier language models on expert-authored clinical reasoning tasks

Samiha A. Ismail, Fan X. Chen, Ali Merali

Multiple-choice medical benchmarks are increasingly saturated, and recent rubric-based evaluations such as HealthBench have shown that open-ended clinical performance is far from s…