2 papers
cs.CL2026
SparPR: Runtime KV-Cache Recovery for Resource-Constrained LLM Inference on Consumer Hardware
Jieyun Deng, Keming Hu, Yanghe Liu +1
Running large language models (LLMs) on consumer hardware is bottlenecked by the key-value (KV) cache, which grows with every decoded token and quickly exhausts the memory and band…
cs.CV2026
InteractionBench: A Real-Time Interaction Benchmark for Streaming Video Systems
Enxin Song, Suhao Yu, Yifei Xu +7
A video assistant must speak when its instruction warrants a response and stay silent otherwise. We introduce a benchmark that evaluates this decision for the complete system of mo…