An Optical KV Cache Network for Disaggregated LLM Serving

Seongwon Yoon, Shimeng Yu

In disaggregated LLM serving, each request's KV cache moves from a prefill GPU to a decode GPU before the response begins, and a coding-agent turn often moves the KV cache of its w…