When Keywords Drop but Classifiers Hold: Soft Refusals under KV Cache Compression

Kang Chen, Xiuze Zhou, Hong Chen +1

KV cache compression is widely used for long context LLM inference under memory constraints, while deployed systems typically score refusals after generation with keyword filters o…