596 citations · 901 across the 38 of their papers we have counts for
7 papers · 1 filter
How2: A Large-scale Dataset for Multimodal Language Understanding
Ramon Sanabria, Ozan Caglayan, Shruti Palaskar +4
In this paper, we introduce How2, a multimodal collection of instructional videos with English subtitles and crowdsourced Portuguese translations. We also present integrated sequen…
Assessing Crosslingual Discourse Relations in Machine Translation
Karin Sim Smith, Lucia Specia
In an attempt to improve overall translation quality, there has been an increasing focus on integrating more linguistic elements into Machine Translation (MT). While significant pr…
End-to-end Image Captioning Exploits Multimodal Distributional Similarity
Pranava Madhyastha, Josiah Wang, Lucia Specia
We hypothesize that end-to-end neural image captioning systems work seemingly well because they exploit and learn `distributional similarity' in a multimodal feature space by mappi…
Exploring Gap Filling as a Cheaper Alternative to Reading Comprehension Questionnaires when Evaluating Machine Translation for Gisting
Mikel L. Forcada, Carolina Scarton, Lucia Specia +2
A popular application of machine translation (MT) is gisting: MT is consumed as is to make sense of text in a foreign language. Evaluation of the usefulness of MT for gisting is su…
Defoiling Foiled Image Captions
Pranava Madhyastha, Josiah Wang, Lucia Specia
We address the task of detecting foiled image captions, i.e. identifying whether a caption contains a word that has been deliberately replaced by a semantically similar word, thus…
A Report on the Complex Word Identification Shared Task 2018
Seid Muhie Yimam, Chris Biemann, Shervin Malmasi +5
We report the findings of the second Complex Word Identification (CWI) shared task organized as part of the BEA workshop co-located with NAACL-HLT'2018. The second CWI shared task…
Object Counts! Bringing Explicit Detections Back into Image Captioning
Josiah Wang, Pranava Madhyastha, Lucia Specia
The use of explicit object detectors as an intermediate step to image captioning - which used to constitute an essential stage in early work - is often bypassed in the currently do…