Vision-language models for chest radiography do not always need the image

Mahshad Lotfinia, Sebastian Ziegelmayer, Lisa Adams +3

Medical vision-language models report strong chest radiograph accuracy, and this is increasingly read as evidence that they use the image. That inference is unsafe: a model exploit…