paper

Beyond Binary Audits: Does Guideline Grounding Mitigate Decision-Space Framing in LLM Opioid Prescribing?

arXiv:2611.18631

Abstract

Audits of LLMs for bias in opioid prescribing have largely relied on binary treatment decisions, a signal that current models have saturated. We introduce Q-Pain++, a full-factorial stress test that holds clinical content fixed while independently varying clinical risk factors and the granularity of the available dosage options. Adding an intermediate dosage option to otherwise unchanged vignettes substantially lowers agreement with expert-annotated dosages for most models, while demographic differences in dosage decisions remain small in all but one configuration once clinical risk factors are added. Grounding models in perioperative guidelines through retrieval reduces this framing effect on average but does not eliminate it, and one model's treatment decisions change when the retrieved passages are reordered. These results suggest that audits should vary the answer format, not only patient identity. We will release our codebase as well as Guideline-RAG-associated resources on GitHub (https://github.com/su-boussard-lab/llm-guideline-grounding-opioids).

arXiv comment14 pages, 6 figures, 6 tables