297 citations · 1.8k across the 50 of their papers we have counts for
4 papers · 1 filter
Language ID in the Wild: Unexpected Challenges on the Path to a Thousand-Language Web Text Corpus
Isaac Caswell, Theresa Breiner, Daan van Esch +1
Large text corpora are increasingly important for a wide variety of Natural Language Processing (NLP) tasks, and automatic language identification (LangID) is a core technology nee…
Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation
Aditya Siddhant, Ankur Bapna, Yuan Cao +5
Over the last few years two promising research directions in low-resource neural machine translation (NMT) have emerged. The first focuses on utilizing high-resource languages to i…
Controlling Computation versus Quality for Neural Sequence Models
Ankur Bapna, Naveen Arivazhagan, Orhan Firat
Most neural networks utilize the same amount of compute for every example independent of the inherent complexity of the input. Further, methods that adapt the amount of computation…
Faster Transformer Decoding: N-gram Masked Self-Attention
Ciprian Chelba, Mia Chen, Ankur Bapna +1
Motivated by the fact that most of the information relevant to the prediction of target tokens is drawn from the source sentence , we propose truncating the tar…