6 papers
Beyond Anonymous Captions: Grounding Character Identity in Video Captioning and Question Answering
Anas Filali Razzouki, Killian Steunou, Khalil Guetari +3
Linking people's appearance and actions to character identities is essential for understanding video narratives. We present a framework for identity-aware video captioning and pers…
PEEK: Picking Essential frames via Efficient Knowledge distillation
Killian Steunou, Anas Filali Razzouki, Khalil Guetari +2
Video-language models can process only a limited number of frames, making frame selection a key bottleneck for efficient video captioning. Most captioning pipelines still rely on u…
Frame Sampling Strategies Matter: A Benchmark for small vision language models
Marija Brkic, Anas Filali Razzouki, Yannis Tevissen +2
Comparing vision language models on videos is particularly complex, as the performances is jointly determined by the model's visual representation capacity and the frame-sampling s…
Towards Retrieval Augmented Generation over Large Video Libraries
Yannis Tevissen, Khalil Guetari, Frédéric Petitpont
Video content creators need efficient tools to repurpose content, a task that often requires complex manual or automated searches. Crafting a new video from large video libraries r…
Multimodal Chaptering for Long-Form TV Newscast Video
Khalil Guetari, Yannis Tevissen, Frédéric Petitpont
We propose a novel approach for automatic chaptering of TV newscast videos, addressing the challenge of structuring and organizing large collections of unsegmented broadcast conten…
Inserting Faces inside Captions: Image Captioning with Attention Guided Merging
Yannis Tevissen, Khalil Guetari, Marine Tassel +2
Image captioning models are widely used to describe recent and archived pictures with the objective of improving their accessibility and retrieval. Yet, these approaches tend to be…