ZSMerge: Zero-Shot KV Cache Compression for Memory-Efficient Long-Context LLMs

Xin Liu, Xudong Wang, Pei Liu +1

The linear growth of key-value (KV) cache memory and quadratic computational in attention mechanisms complexity pose significant bottlenecks for large language models (LLMs) in lon…