How Many Counterfactuals Does It Take? Probing VLM Hallucinations Through Circuits and Causal Effects

Abhivansh Gupta, Simardeep Singh, Advika Sinha +2

Visual Language Models (VLMs) are known to produce hallucinated predictions that are not grounded in visual evidence, yet existing approaches lack a principled understanding of how…