3 papers
cs.CL2026
TwinKV: A Composable Repair Pass for KV Cache Eviction via Pairwise Key Redundancy
Hong Chen, Yudong Zeng, Yongwei Huang +4
Long-context inference is bottlenecked by the memory footprint of the key-value (KV) cache, especially for small models under tight resource budgets. Existing KV cache eviction met…
cs.CL2026
SemTrace: Source-Grounded Semantic Signatures for Tracing LLM Exposure to Protected Documents
Junyan Zhang, Yudong Zeng, Yongwei Huang +3
Large language models are increasingly used to read documents and produce downstream text, creating a provenance problem when the document owner cannot control or inspect the model…
cs.CL2026
A Sparse Glimpse of the Whole: Train-Free Self-Speculative Decoding
Yuesong Liu, Yuan Zeng, Min Lyu +3
Speculative decoding alleviates the memory-bandwidth bottleneck in large language model inference, but its acceleration is jointly constrained by drafting overhead, token acceptanc…