85 citations · 356 across the 26 of their papers we have counts for
6 papers · 1 filter
Visual Grounding of Inter-lingual Word-Embeddings
Wafaa Mohammed, Hassan Shahmohammadi, Hendrik P. A. Lensch +1
Visual grounding of Language aims at enriching textual representations of language with multiple sources of visual knowledge such as images and videos. Although visual grounding is…
Diverse Video Captioning by Adaptive Spatio-temporal Attention
Zohreh Ghaderi, Leonard Salewski, Hendrik P. A. Lensch
To generate proper captions for videos, the inference needs to identify relevant concepts and pay attention to the spatial relationships between them as well as to the temporal dev…
How direct is the link between words and images?
Hassan Shahmohammadi, Maria Heitmeier, Elnaz Shafaei-Bajestan +2
Current word embedding models despite their success, still suffer from their lack of grounding in the real world. In this line of research, Gunther et al. 2022 proposed a behaviora…
Language with Vision: a Study on Grounded Word and Sentence Embeddings
Hassan Shahmohammadi, Maria Heitmeier, Elnaz Shafaei-Bajestan +2
Grounding language in vision is an active field of research seeking to construct cognitively plausible word and sentence representations by incorporating perceptual knowledge from…
SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collections
Mark Boss, Andreas Engelhardt, Abhishek Kar +5
Inverse rendering of an object under entirely unknown capture conditions is a fundamental challenge in computer vision and graphics. Neural approaches such as NeRF have achieved ph…
CLEVR-X: A Visual Reasoning Dataset for Natural Language Explanations
Leonard Salewski, A. Sophia Koepke, Hendrik P. A. Lensch +1
Providing explanations in the context of Visual Question Answering (VQA) presents a fundamental problem in machine learning. To obtain detailed insights into the process of generat…