187 citations · 475 across the 25 of their papers we have counts for
4 papers · 1 filter
Multimodal Machine Translation through Visuals and Speech
Umut Sulubacak, Ozan Caglayan, Stig-Arne Grönroos +4
Multimodal machine translation involves drawing information from more than one modality, based on the assumption that the additional modalities will contain useful alternative view…
Bootstrapping Disjoint Datasets for Multilingual Multimodal Representation Learning
Ákos Kádár, Grzegorz Chrupała, Afra Alishahi +1
Recent work has highlighted the advantage of jointly learning grounded sentence representations from multiple languages. However, the data used in these studies has been limited to…
Compositional Generalization in Image Captioning
Mitja Nikolaus, Mostafa Abdou, Matthew Lamm +2
Image captioning models are usually evaluated on their ability to describe a held-out set of images, not on their ability to generalize to unseen concepts. We study the problem of…
Cross-lingual Visual Verb Sense Disambiguation
Spandana Gella, Desmond Elliott, Frank Keller
Recent work has shown that visual context improves cross-lingual sense disambiguation for nouns. We extend this line of work to the more challenging task of cross-lingual verb sens…