4 papers · 1 filter
Beyond Anonymous Captions: Grounding Character Identity in Video Captioning and Question Answering
Anas Filali Razzouki, Killian Steunou, Khalil Guetari +3
Linking people's appearance and actions to character identities is essential for understanding video narratives. We present a framework for identity-aware video captioning and pers…
PEEK: Picking Essential frames via Efficient Knowledge distillation
Killian Steunou, Anas Filali Razzouki, Khalil Guetari +2
Video-language models can process only a limited number of frames, making frame selection a key bottleneck for efficient video captioning. Most captioning pipelines still rely on u…
Frame Sampling Strategies Matter: A Benchmark for small vision language models
Marija Brkic, Anas Filali Razzouki, Yannis Tevissen +2
Comparing vision language models on videos is particularly complex, as the performances is jointly determined by the model's visual representation capacity and the frame-sampling s…
Inserting Faces inside Captions: Image Captioning with Attention Guided Merging
Yannis Tevissen, Khalil Guetari, Marine Tassel +2
Image captioning models are widely used to describe recent and archived pictures with the objective of improving their accessibility and retrieval. Yet, these approaches tend to be…