105 citations · 226 across the 19 of their papers we have counts for
10 papers · 1 filter
Modulated Fusion using Transformer for Linguistic-Acoustic Emotion Recognition
Jean-Benoit Delbrouck, Noé Tits, Stéphane Dupont
This paper aims to bring a new lightweight yet powerful solution for the task of Emotion Recognition and Sentiment Analysis. Our motivation is to propose two architectures based on…
A Transformer-based joint-encoding for Emotion Recognition and Sentiment Analysis
Jean-Benoit Delbrouck, Noé Tits, Mathilde Brousmiche +1
Understanding expressed sentiment and emotions are two crucial factors in human multimodal language. This paper describes a Transformer-based joint-encoding (TBJE) for the task of…
Can adversarial training learn image captioning ?
Jean-Benoit Delbrouck, Bastien Vanderplaetse, Stéphane Dupont
Recently, generative adversarial networks (GAN) have gathered a lot of interest. Their efficiency in generating unseen samples of high quality, especially images, has improved over…
Adversarial reconstruction for Multi-modal Machine Translation
Jean-Benoit Delbrouck, Stéphane Dupont
Even with the growing interest in problems at the intersection of Computer Vision and Natural Language, grounding (i.e. identifying) the components of a structured description in a…
Bringing back simplicity and lightliness into neural image captioning
Jean-Benoit Delbrouck, Stéphane Dupont
Neural Image Captioning (NIC) or neural caption generation has attracted a lot of attention over the last few years. Describing an image with a natural language has been an emergin…
UMONS Submission for WMT18 Multimodal Translation Task
Jean-Benoit Delbrouck, Stéphane Dupont
This paper describes the UMONS solution for the Multimodal Machine Translation Task presented at the third conference on machine translation (WMT18). We explore a novel architectur…
Modulating and attending the source image during encoding improves Multimodal Translation
Jean-Benoit Delbrouck, Stéphane Dupont
We propose a new and fully end-to-end approach for multimodal translation where the source text encoder modulates the entire visual input processing using conditional batch normali…
An empirical study on the effectiveness of images in Multimodal Neural Machine Translation
Jean-Benoit Delbrouck, Stéphane Dupont
In state-of-the-art Neural Machine Translation (NMT), an attention mechanism is used during decoding to enhance the translation. At every step, the decoder uses this mechanism to f…
Visually Grounded Word Embeddings and Richer Visual Features for Improving Multimodal Neural Machine Translation
Jean-Benoit Delbrouck, Stéphane Dupont, Omar Seddati
In Multimodal Neural Machine Translation (MNMT), a neural model generates a translated sentence that describes an image, given the image itself and one source descriptions in Engli…
Multimodal Compact Bilinear Pooling for Multimodal Neural Machine Translation
Jean-Benoit Delbrouck, Stephane Dupont
In state-of-the-art Neural Machine Translation, an attention mechanism is used during decoding to enhance the translation. At every step, the decoder uses this mechanism to focus o…