Showing cs.DCShow all
2 papers · 1 filter
cs.DC2026
PatchKV: Efficient KV Cache Recovery for Dynamically Edited LLM Contexts
Guotao Yang, Rui Guo, Siwei He +3
Long-running LLM agent workflows often revise interior context spans while retaining long suffixes. Although suffix tokens remain unchanged, altered causal histories and rotary pos…
cs.DC2026
AsymSpec: Efficient Cloud-Edge Speculative Decoding over Asymmetric Networks
Guotao Yang, Hao Chen, Rui Guo +5
Cloud-edge speculative decoding places a lightweight draft model at an edge gateway and a higher-quality target model in the cloud, but inserts communication into every speculative…