HeadCast: Casting Attention Heads for Efficient Autoregressive Video Generation

Jinliang Shen, Lianghao Su, Zheming Li +4

Autoregressive (AR) video diffusion models have become a promising paradigm for long and streaming video synthesis, but the continuously growing Key-Value (KV) cache makes attentio…