3 papers
cs.CL2026
Small Frequency Corrections Can Change What Survives KV Cache Compression
Hong Chen, Yudong Zeng, Yongwei Huang +5
Compressing a key-value cache before its next question is known requires choosing what to retain without knowing which evidence will matter. Value energy measures entry strength bu…
cs.CL2026
SemTrace: Source-Grounded Semantic Signatures for Tracing LLM Exposure to Protected Documents
Junyan Zhang, Yudong Zeng, Yongwei Huang +3
Large language models are increasingly used to read documents and produce downstream text, creating a provenance problem when the document owner cannot control or inspect the model…
cs.CL2026
A Sparse Glimpse of the Whole: Train-Free Self-Speculative Decoding
Yuesong Liu, Yuan Zeng, Min Lyu +3
Speculative decoding alleviates the memory-bandwidth bottleneck in large language model inference, but its acceleration is jointly constrained by drafting overhead, token acceptanc…