works on
entity-centric representation 1memory compression 1retrieval 1semantic memory 1streaming video understanding 1

From the 1 of 5 linked papers with an AI index.

collaborators
Showing cs.CLShow all

1 paper · 1 filter

cs.CL2026

KVCrush: Key value cache size-reduction using similarity in head-behaviour

Gopi Krishna Jha, Sameh Gobriel, Liubov Talamanova +1

Key-value (KV) caching has emerged as a crucial optimization technique for accelerating inference in large language models (LLMs). By allowing the attention operation to scale line…