Parallel Key-Value Cache Fusion for Position Invariant RAG

Philhoon Oh, Jinwoo Shin, James Thorne

Recent advancements in Large Language Models (LLMs) underscore the necessity of Retrieval Augmented Generation (RAG) to leverage external information. However, LLMs are sensitive t…