21 citations · 59 across the 41 of their papers we have counts for
6 papers · 1 filter
The Image Reconstruction Game: Drawing Common Ground Through Iterative Multimodal Dialogue
Sherzod Hakimov, Mattia D'Agostini, Ivan Samodelkin +1
We introduce the Image Reconstruction Game, a fully automated benchmark in which a vision-language model issues corrective instructions to an image generator across multiple turns,…
Yes, this Way! Learning to Ground Referring Expressions into Actions with Intra-episodic Feedback from Supportive Teachers
Philipp Sadler, Sherzod Hakimov, David Schlangen
The ability to pick up on language signals in an ongoing interaction is crucial for future machine learning models to collaborate and interact with humans naturally. In this paper,…
Unsupervised Video Summarization via Multi-source Features
Hussain Kanafani, Junaid Ahmed Ghauri, Sherzod Hakimov +1
Video summarization aims at generating a compact yet representative visual summary that conveys the essence of the original video. The advantage of unsupervised approaches is that…
Supervised Video Summarization via Multiple Feature Sets with Parallel Attention
Junaid Ahmed Ghauri, Sherzod Hakimov, Ralph Ewerth
The assignment of importance scores to particular frames or (short) segments in a video is crucial for summarization, but also a difficult task. Previous work utilizes only one sou…
Ontology-driven Event Type Classification in Images
Eric Müller-Budack, Matthias Springstein, Sherzod Hakimov +2
Event classification can add valuable information for semantic search and the increasingly important topic of fact validation in news. So far, only few approaches address image cla…
Classification of Important Segments in Educational Videos using Multimodal Features
Junaid Ahmed Ghauri, Sherzod Hakimov, Ralph Ewerth
Videos are a commonly-used type of content in learning during Web search. Many e-learning platforms provide quality content, but sometimes educational videos are long and cover man…