UMONS Submission for WMT18 Multimodal Translation Task
arXiv:1810.06233
Abstract
This paper describes the UMONS solution for the Multimodal Machine Translation Task presented at the third conference on machine translation (WMT18). We explore a novel architecture, called deepGRU, based on recent findings in the related task of Neural Image Captioning (NIC). The models presented in the following sections lead to the best METEOR translation score for both constrained (English, image) -> German and (English, image) -> French sub-tasks.
References in corpus (4)
- Adam: A Method for Stochastic Optimization
- Does Multimodality Help Human and Machine for Translation and Image Captioning?
- An empirical study on the effectiveness of images in Multimodal Neural Machine Translation
- Modulating and attending the source image during encoding improves Multimodal Translation