DeltaS: Reading the Gated Linear Attention State for KV Cache Eviction in Streaming Video

Taeyoun Kwon, Seungjin Kim, Hyeonyu Kim +1

Recent video-language models increasingly adopt hybrid architectures that interleave linear and full attention layers for efficient long-context processing. While the recurrent sta…