MDSAM:Memory-Driven Sparse Attention Matrix for LVLMs Hallucination Mitigation

Shuaiye Lu, Linjiang Zhou, Xiaochuan Shi

Hallucinations in large vision-language models (LVLMs) often stem from the model's sensitivity to image tokens during decoding, as evidenced by attention peaks observed when genera…