ATTUNER: Recomputation-Free KV Cache Reuse via Query-Side Adaptation

Xinghao Chen, Junnan Dong, Cai Ke +8

Large language model (LLM) agents repeatedly load reusable content, such as skills, documents, and memory entries, into the current context. Re-encoding this content for every requ…