TempoKV: Predictive KV Cache Quantization for Autoregressive Video Generation

Jiahui Hu, Weile Mo, Peiliang Cai +5

Autoregressive (AR) video diffusion models enable streaming generation of long videos but suffer from significant memory overhead due to the rapidly growing KV cache. Existing KV c…