works on
anchor tokens 1diffusion language models 1inference acceleration 1parallel generation 1revocable decoding 1

From the 1 of 23 linked papers with an AI index.

activity
20242026
collaborators
Showing cs.DCShow all

1 paper · 1 filter

cs.DC2026

ForkKV: Scaling Multi-LoRA Agent Serving via Copy-on-Write Disaggregated KV Cache

Shao Wang, Rui Ren, Lin Gui

The serving paradigm of large language models (LLMs) is rapidly shifting towards complex multi-agent workflows where specialized agents collaborate over massive shared contexts. Wh…