5.7k citations · 7.1k across the 26 of their papers we have counts for
8 papers · 1 filter
Adaptive Scheduling for Multi-Task Learning
Sébastien Jean, Orhan Firat, Melvin Johnson
To train neural machine translation models simultaneously on multiple tasks (languages), it is common to sample each task uniformly or in proportion to dataset sizes. As these meth…
Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation
Aditya Siddhant, Melvin Johnson, Henry Tsai +5
The recently proposed massively multilingual neural machine translation (NMT) system has been shown to be capable of translating over 100 languages to and from English within a sin…
Small and Practical BERT Models for Sequence Labeling
Henry Tsai, Jason Riesa, Melvin Johnson +3
We propose a practical scheme to train a single multilingual sequence labeling model that yields state of the art results and is small and fast enough to run on a single CPU. Start…
Massively Multilingual Neural Machine Translation in the Wild: Findings and Challenges
Naveen Arivazhagan, Ankur Bapna, Orhan Firat +10
We introduce our efforts towards building a universal neural machine translation (NMT) system capable of translating between any language pair. We set a milestone towards this goal…
Direct speech-to-speech translation with a sequence-to-sequence model
Ye Jia, Ron J. Weiss, Fadi Biadsy +4
We present an attention-based sequence-to-sequence neural network which can directly translate speech from one language into speech in another language, without relying on an inter…
The Missing Ingredient in Zero-Shot Neural Machine Translation
Naveen Arivazhagan, Ankur Bapna, Orhan Firat +3
Multilingual Neural Machine Translation (NMT) models are capable of translating between multiple source and target languages. Despite various approaches to train such models, they…