Where To Look? : Causal Tracing of Vision Encoders in VLM

Naren Kumar S, Tirth Bhatt, Mayank Singh

Vision-language models can describe an image with remarkable accuracy, yet a more fundamental question remains unanswered: what visual information actually drives their answers? In…