Enabling KV Caching of Shared Prefix for Diffusion Language Models

Younghun Go, Jaehoon Han, Changyong Shin +2

Key-value (KV) caching for shared prefixes is essential for high-throughput large language model (LLM) serving, but it faces critical challenges in emerging diffusion language mode…