Sigmoid Attention as a Better Substrate for Learned KV Cache Eviction

Isaac, Li

Learned KV-cache eviction often faces a soft-to-hard mismatch: during training, differentiable gates typically attenuate token contributions, whereas inference saves memory only wh…