A Clinical Trial Design Approach to Auditing Language Models in Healthcare Setting

Lovedeep Gondara, Jonathan Simkin

We present an audit mechanism for language models, with a focus on models deployed in the healthcare setting. Our proposed mechanism takes inspiration from clinical trial design wh…