Trust the Mass: Forced Weights in KV-Cache Eviction

Jack Shi, Jerry Gu

Every deployed KV-cache-eviction rule and every top-$k$ sparse-attention rule keeps a subset of the keys, discards the rest, and renormalizes the attention weights over the kept se…