67 citations · 143 across the 16 of their papers we have counts for
3 papers · 1 filter
LongT5: Efficient Text-To-Text Transformer for Long Sequences
Mandy Guo, Joshua Ainslie, David Uthus +4
Recent work has shown that either (1) increasing the input length or (2) increasing model size can improve the performance of Transformer-based neural models. In this paper, we pre…
MURAL: Multimodal, Multitask Retrieval Across Languages
Aashi Jain, Mandy Guo, Krishna Srinivasan +5
Both image-caption pairs and translation pairs provide the means to learn deep representations of and connections between languages. We use both types of pairs in MURAL (MUltimodal…
Towards Universality in Multilingual Text Rewriting
Xavier Garcia, Noah Constant, Mandy Guo +1
In this work, we take the first steps towards building a universal rewriter: a model capable of rewriting text in any language to exhibit a wide variety of attributes, including st…