Joint Encoding of KV-Cache Blocks for Scalable LLM Serving

Joseph Kampeas, Emir Haleva

Modern large language models (LLMs) drive interactive AI systems but are bottlenecked by the memory-heavy growth of key-value (KV) caches, which limits real-time throughput under c…