Multimodal Adaptive Retrieval Augmented Generation through Internal Representation Learning

Ruoshuang Du, Xin Sun, Qiang Liu +4

Visual Question Answering systems face reliability issues due to hallucinations, where models generate answers misaligned with visual input or factual knowledge. While Retrieval Au…