116 citations · 441 across the 62 of their papers we have counts for
13 papers · 1 filter
FlauBERT: Unsupervised Language Model Pre-training for French
Hang Le, Loïc Vial, Jibril Frej +7
Language models have become a key step to achieve state-of-the art results in many different Natural Language Processing (NLP) tasks. Leveraging the huge amount of unlabeled texts…
Character-based NMT with Transformer
Rohit Gupta, Laurent Besacier, Marc Dymetman +1
Character-based translation has several appealing advantages, but its performance is in general worse than a carefully tuned BPE baseline. In this paper we study the impact of char…
The LIG system for the English-Czech Text Translation Task of IWSLT 2019
Loïc Vial, Benjamin Lecouteux, Didier Schwab +2
In this paper, we present our submission for the English to Czech Text Translation Task of IWSLT 2019. Our system aims to study how pre-trained language models, used as input embed…
Naver Labs Europe's Systems for the Document-Level Generation and Translation Task at WNGT 2019
Fahimeh Saleh, Alexandre Bérard, Ioan Calapodescu +1
Recently, neural models led to significant improvements in both machine translation (MT) and natural language generation tasks (NLG). However, generation of long descriptive summar…
ON-TRAC Consortium End-to-End Speech Translation Systems for the IWSLT 2019 Shared Task
Ha Nguyen, Natalia Tomashenko, Marcely Zanon Boito +5
This paper describes the ON-TRAC Consortium translation systems developed for the end-to-end model task of IWSLT Evaluation 2019 for the English-to-Portuguese language pair. ON-TRA…
Controlling Utterance Length in NMT-based Word Segmentation with Attention
Pierre Godard, Laurent Besacier, Francois Yvon
One of the basic tasks of computational language documentation (CLD) is to identify word boundaries in an unsegmented phonemic stream. While several unsupervised monolingual word s…
How Does Language Influence Documentation Workflow? Unsupervised Word Discovery Using Translations in Multiple Languages
Marcely Zanon Boito, Aline Villavicencio, Laurent Besacier
For language documentation initiatives, transcription is an expensive resource: one minute of audio is estimated to take one hour and a half on average of a linguist's work (Austin…
Word Recognition, Competition, and Activation in a Model of Visually Grounded Speech
William N. Havard, Jean-Pierre Chevrot, Laurent Besacier
In this paper, we study how word-like units are represented and activated in a recurrent neural model of visually grounded speech. The model used in our experiments is trained to p…
Gender Representation in French Broadcast Corpora and Its Impact on ASR Performance
Mahault Garnerin, Solange Rossato, Laurent Besacier
This paper analyzes the gender representation in four major corpora of French broadcast. These corpora being widely used within the speech processing community, they are a primary…
MaSS: A Large and Clean Multilingual Corpus of Sentence-aligned Spoken Utterances Extracted from the Bible
Marcely Zanon Boito, William N. Havard, Mahault Garnerin +2
The CMU Wilderness Multilingual Speech Dataset (Black, 2019) is a newly published multilingual speech dataset based on recorded readings of the New Testament. It provides data to b…
Empirical Evaluation of Sequence-to-Sequence Models for Word Discovery in Low-resource Settings
Marcely Zanon Boito, Aline Villavicencio, Laurent Besacier
Since Bahdanau et al. [1] first introduced attention for neural machine translation, most sequence-to-sequence models made use of attention mechanisms [2, 3, 4]. While they produce…
The Zero Resource Speech Challenge 2019: TTS without T
Ewan Dunbar, Robin Algayres, Julien Karadayi +10
We present the Zero Resource Speech Challenge 2019, which proposes to build a speech synthesizer without any text or phonetic labels: hence, TTS without T (text-to-speech without t…
Models of Visually Grounded Speech Signal Pay Attention To Nouns: a Bilingual Experiment on English and Japanese
William N. Havard, Jean-Pierre Chevrot, Laurent Besacier
We investigate the behaviour of attention in neural models of visually grounded speech trained on two languages: English and Japanese. Experimental results show that attention focu…