Tessera: Demand-Driven KV Cache Management for Retrieval-Augmented LLM Serving

Fei Fang, Chung-Hsiang Lo, Yi Liu +2

RAG and retrieval-based agent memory both inject retrieved content into LLM prompts, as document chunks and recalled memory records, respectively. The same content can recur across…