1 paper
Yanhong Qian, Xuanying He, Qingguo Meng +3
KV cache is evolving from a serving optimization into an external memory substrate for long-term LLM agents. In a shared multi-user deployment, however, reusable KV blocks introduc…