Mitigating Multimodal LLMs Hallucinations via Relevance Propagation at Inference Time

Itai Allouche, Joseph Keshet

Multimodal large language models (MLLMs) achieve strong performance on vision- and audio-language tasks, yet can generate responses that conflict with the given visual or auditory…