Unbiased Visual Reasoning with Controlled Visual Inputs

Zhaonan Li, Shijie Lu, Fei Wang +11

End-to-end Vision-language Models (VLMs) often answer visual questions by exploiting spurious correlations instead of causal visual evidence, and can become more shortcut-prone whe…