1 paper
Inesh Chakrabarti, David Limpus, Aditi Ghai Rana +4
Context-heavy agents place unusual pressure on the key-value (KV) cache: long prefixes are reused across many short turns, while concurrency determines whether the serving system c…