373 citations · 841 across the 71 of their papers we have counts for
6 papers · 1 filter
Attention Weights in Transformer NMT Fail Aligning Words Between Sequences but Largely Explain Model Predictions
Javier Ferrando, Marta R. Costa-jussà
This work proposes an extensive analysis of the Transformer architecture in the Neural Machine Translation (NMT) setting. Focusing on the encoder-decoder attention mechanism, we pr…
Efficient Transformer for Direct Speech Translation
Belen Alastruey, Gerard I. Gállego, Marta R. Costa-jussà
The advent of Transformer-based models has surpassed the barriers of text. When working with speech, we must face a problem: the sequence length of an audio input is not suitable f…
End-to-End Speech Translation with Pre-trained Models and Adapters: UPC at IWSLT 2021
Gerard I. Gállego, Ioannis Tsiamas, Carlos Escolano +2
This paper describes the submission to the IWSLT 2021 offline speech translation task by the UPC Machine Translation group. The task consists of building a system capable of transl…
Impact of Gender Debiased Word Embeddings in Language Modeling
Christine Basta, Marta R. Costa-jussà
Gender, race and social biases have recently been detected as evident examples of unfairness in applications of Natural Language Processing. A key path towards fairness is to under…
How to Write a Bias Statement: Recommendations for Submissions to the Workshop on Gender Bias in NLP
Christian Hardmeier, Marta R. Costa-jussà, Kellie Webster +2
At the Workshop on Gender Bias in NLP (GeBNLP), we'd like to encourage authors to give explicit consideration to the wider aspects of bias and its social implications. For the 2020…
Sparsely Factored Neural Machine Translation
Noe Casas, Jose A. R. Fonollosa, Marta R. Costa-jussà
The standard approach to incorporate linguistic information to neural machine translation systems consists in maintaining separate vocabularies for each of the annotated features t…