CodecSight: Leveraging Video Codec Signals for Efficient Streaming VLM Inference

Yulin Zou, Yan Chen, Wenyan Chen +6

Continuous inference over concurrent video streams imposes substantial compute and memory demands on vision-language model (VLM) serving. Streaming inference uses sliding windows t…