How Well Do Vision-Language Models Understand Movies?

Emmanouil Zaranis, António Farinhas, Saul Santos +28

Vision-language models (VLMs) can increasingly handle extended contexts and answer questions about long videos--but can they understand the narrative structure of movies as humans…