174 citations · 208 across the 11 of their papers we have counts for
4 papers · 1 filter
The Illusion of Readiness in Health AI
Yu Gu, Jingjing Fu, Xiaodong Liu +29
Large language models have demonstrated remarkable performance in a wide range of medical benchmarks. Yet underneath the seemingly promising results lie salient growth areas, espec…
CancerGUIDE: Cancer Guideline Understanding via Internal Disagreement Estimation
Alyssa Unell, Noel C. F. Codella, Sam Preston +13
The National Comprehensive Cancer Network (NCCN) provides evidence-based guidelines for cancer treatment. Translating complex patient presentations into guideline-compliant treatme…
Sequential Diagnosis with Language Models
Harsha Nori, Mayank Daswani, Christopher Kelly +12
Artificial intelligence holds great promise for expanding access to expert medical knowledge and reasoning. However, most evaluations of language models rely on static vignettes an…
JSONSchemaBench: A Rigorous Benchmark of Structured Outputs for Language Models
Saibo Geng, Hudson Cooper, Michał Moskal +6
Reliably generating structured outputs has become a critical capability for modern language model (LM) applications. Constrained decoding has emerged as the dominant technology acr…