2 papers
cs.CL2026
Lost in Context Compaction: When LLM Systems Drop Side Constraints
Zhiqi Wang, Yichi Zhang, Dongwon Lee +2
When the context window is under pressure, LLM systems compact prior context to continue ongoing tasks. We study Side Constraints (SCs), user-issued instructions such as "do not de…
cs.CR2026
HijackKV: New Threat in Position-Independent KV Cache Reuse
Yichi Zhang, Zhiqi Wang, Huan Zhang +1
Key-Value (KV) cache reduces inference latency in large language models (LLMs). Traditional prefix-based reuse has low cache hit rates across inference requests because it requires…