2 papers
cs.CL2026
ATTUNER: Recomputation-Free KV Cache Reuse via Query-Side Adaptation
Xinghao Chen, Junnan Dong, Cai Ke +8
Large language model (LLM) agents repeatedly load reusable content, such as skills, documents, and memory entries, into the current context. Re-encoding this content for every requ…
cs.LG2026
Draft in Parallel, Condition Through Depth: Adjacent Causal Injection for Speculative Decoding
Haohui Zhang, Keyu Chen, Haocheng Sun +4
Parallel speculative drafting generates multiple candidates in one backbone pass, but independent token selection can produce inconsistent continuations that shorten the accepted p…