To Keep or Not to Keep: Learning KV Cache Retention in Disaggregated LLM Serving Systems

Dong Liu, Yanxuan Yu, Eric Jiang +2

Disaggregated \textsc{LLM} serving separates prefill and decode across node pools, placing a network fabric between \textsc{KV}-cache computation and consumption. This breaks a key…