MLLMs Hallucinate when Information Distribution Drifts in Synergy Heads

Meng'en Qin, Junye Chen, Jucheng Liu +3

Multimodal Large Language Models (MLLMs) often struggle with hallucinations, thus hindering their reliable practical applications. Existing attention-based mitigation methods mainl…