EchoPress: Query-Agnostic KV Cache Pruning via Virtual Context Reconstruction

Jiawei Lin, Saibo Geng, Thomas Bourgeat

KV cache pruning reduces long-context inference memory usage by evicting less important key-value pairs. KVzip estimates importance through context reconstruction: prompting a mode…