5 papers
Counterfactual Marginalisation: Framework for Evaluating Robustness to Nuisance Variables
Yasin Ibrahim, Hermione Warr, Robin J. Evans +1
Machine learning models can achieve strong test performance while relying on demographic or acquisition-related shortcuts. We propose counterfactual (CF) marginalisation as a test-…
Error Detection for PET/CT Radiology Reports: Domain-Specific vs Large Language Models
Hermione Warr, Harry Anthony, Lilli J Freischem +3
Errors in radiology reports can adversely affect patient treatment, yet automated report quality assurance remains challenging because errors are often subtle and require domain ex…
The Invisible Gorilla Effect in Out-of-distribution Detection
Harry Anthony, Ziyun Liang, Hermione Warr +1
Deep Neural Networks achieve high performance in vision tasks by learning features from regions of interest (ROI) within images, but their performance degrades when deployed on out…
Specialised or Generic? Tokenization Choices for Radiology Language Models
Hermione Warr, Wentian Xu, Harry Anthony +3
The vocabulary used by language models (LM) - defined by the tokenizer - plays a key role in text generation quality. However, its impact remains under-explored in radiology. In th…
Quality Control for Radiology Report Generation Models via Auxiliary Auditing Components
Hermione Warr, Yasin Ibrahim, Daniel R. McGowan +1
Automation of medical image interpretation could alleviate bottlenecks in diagnostic workflows, and has become of particular interest in recent years due to advancements in natural…