Showing cs.AIShow all
2 papers · 1 filter
cs.AI2026
Just Let Linear States Forget the Distant Past: Prefix Caching via Suffix Replay for Hybrid LLMs
Yirui Liu, Ruoling Qi, Xuaner Wu +6
Hybrid LLMs interleave full-attention layers with linear-attention layers to reduce long-context inference cost, but this structure complicates prefix caching. Full-attention KV ca…
cs.AI2026
REVISE: Validity-Guided Recovery for Online Revisions in Agent Workflows
Ruoling Qi, Xuaner Wu, Penghang Liu +2
Agent revisions expose a fundamental correctness--efficiency trade-off during concurrent execution. Discarding ongoing work preserves latest-version correctness but wastes progress…