1 paper · 1 filter
Nathan Ordonez, Thomas Parnell
Retrieval-augmented and agentic workloads repeatedly prefill recurring predictable structured inputs (which we call "spans") such as documents and code files. Yet, prefix caching i…