3 papers
cs.AI2026
REVISE: Validity-Guided Recovery for Online Revisions in Agent Workflows
Ruoling Qi, Xuaner Wu, Penghang Liu +2
Agent revisions expose a fundamental correctness--efficiency trade-off during concurrent execution. Discarding ongoing work preserves latest-version correctness but wastes progress…
cs.LG2026
Tail-Replay: Escaping the Curse of Linear Attention in Prefix Caching for Hybrid LLMs
Yirui Liu, Ruoling Qi, Xuaner Wu +2
Hybrid large language models interleave full-attention layers with linear-attention layers to reduce the cost of long-context inference. This structure complicates prefix caching:…
cs.AI2026
LinearKV: One Cached State Suffices for Position-Independent Caching in Hybrid LLMs
Yirui Liu, Ruoling Qi, Longwen Wang +5
LLM serving is increasingly accelerated by position-independent caching (PIC). Existing PIC methods, however, are built for full-attention models, where a token-indexed KV cache un…