CacheFocus: Dynamic Cache Re-Positioning for Efficient Retrieval-Augmented Generation

Kun-Hui Lee, Eunhwan Park, Donghoon Han +1

Large Language Models (LLMs) excel across a variety of language tasks yet are constrained by limited input lengths and high computational costs. Existing approaches\textemdash such…