Gradient-guided Attention Map Editing: Towards Efficient Contextual Hallucination Mitigation

Yu Wang, Kamalika Das, Xiang Gao +3

In tasks like summarization and open-book question answering (QA), Large Language Models (LLMs) often encounter "contextual hallucination", where they produce irrelevant or incorre…