AttnComp: Attention-Guided Adaptive Context Compression for Retrieval-Augmented Generation

Lvzhou Luo, Yixuan Cao, Ping Luo

Retrieval-augmented generation improves the factual accuracy of Large Language Models (LLMs) by incorporating external context, but often suffers from irrelevant retrieved content…