Role-Break in Attention Heads: Understanding and Detecting Hallucinations in VLMs

Mingyu Wang, Weilin Jin, Wenbo Li +5

Despite remarkable progress in vision-language generation, Vision-Language Models (VLMs) remain prone to hallucinations, producing content that is inconsistent with or unsupported…