MuKV: Multi-Grained KV Cache Compression for Long Streaming Video Question-Answering

Junbin Xiao, Jiajun Chen, Tianxiang Sun +2

Long streaming video QA remains challenging due to growing visual tokens and limited reasoning length of large language models (LLMs). KV-caching stores the Key-Value (KV) of the h…