Showing 2024Show all
3 papers · 1 filter
cs.CV2024
Structured Spatial Reasoning with Open Vocabulary Object Detectors
Negar Nejatishahidin, Madhukar Reddy Vongala, Jana Kosecka
Reasoning about spatial relationships between objects is essential for many real-world robotic tasks, such as fetch-and-delivery, object rearrangement, and object search. The abili…
cs.CV2024
Gloss2Text: Sign Language Gloss translation using LLMs and Semantically Aware Label Smoothing
Pooya Fayyazsanavi, Antonios Anastasopoulos, Jana Košecká
Sign language translation from video to spoken text presents unique challenges owing to the distinct grammar, expression nuances, and high variation of visual appearance across dif…
cs.CL2024
Beyond Image-Text Matching: Verb Understanding in Multimodal Transformers Using Guided Masking
Ivana Beňová, Jana Košecká, Michal Gregor +3
The dominant probing approaches rely on the zero-shot performance of image-text matching tasks to gain a finer-grained understanding of the representations learned by recent multim…