QCFuse: Query-Centric Cache Fusion for Efficient RAG Inference

Jianxin Yan, Zeheng Qian, Wangze Ni +6

Cache fusion accelerates generation process of LLMs equipped with RAG through KV caching and selective token recomputation, thereby reducing computational costs and improving effic…