1 paper · 1 filter
Talia Q. Chen, Daniel Waddington, Narangerelt Batsoyol +1
Modern LLM serving increasingly extends KV caches beyond GPU memory into host DRAM, SSDs, and remote storage, yet these stores remain largely governed by workload-agnostic policies…