Look Where You Say You're Looking: Self-Grounded Attention for Visual Reasoning

Uri Berger, Gal Chechik, Gal Dalal

We introduce Self-Saliency, a method for training Vision-Language Models (VLMs) to increase the alignment between their visual attention and the image regions mentioned in their re…