activity
20182025
most citedmT5: A massively multilingual pre-trained text-to-text transformer

602 citations · 1.6k across the 24 of their papers we have counts for

collaborators
Showing 2020Show all

7 papers · 1 filter

cs.CL2020

TicketTalk: Toward human-level performance with end-to-end, transaction-based dialog systems

Bill Byrne, Karthik Krishnamoorthi, Saravanan Ganesh +1

We present a data-driven, end-to-end approach to transaction-based dialog systems that performs at near-human levels in terms of verbal response quality and factual grounding accur…

cs.CL2020

Towards Zero-Shot Multilingual Synthetic Question and Answer Generation for Cross-Lingual Reading Comprehension

Siamak Shakeri, Noah Constant, Mihir Sanjay Kale +1

We propose a simple method to generate multilingual question and answer pairs on a large scale through the use of a single generative model. These synthetic samples can be used to…

cs.CL2020★ 602 cited

mT5: A massively multilingual pre-trained text-to-text transformer

Linting Xue, Noah Constant, Adam Roberts +5

The recent "Text-to-Text Transfer Transformer" (T5) leveraged a unified text-to-text format and scale to attain state-of-the-art results on a wide variety of English-language NLP t…

cs.CL2020★ 30 cited

Text-to-Text Pre-Training for Data-to-Text Tasks

Mihir Kale, Abhinav Rastogi

We study the pre-train + fine-tune strategy for data-to-text tasks. Our experiments indicate that text-to-text pre-training in the form of T5, enables simple, end-to-end transforme…

cs.CL2020★ 1 cited

Machine Translation Pre-training for Data-to-Text Generation -- A Case Study in Czech

Mihir Kale, Scott Roy

While there is a large body of research studying deep learning methods for text generation from structured data, almost all of it focuses purely on English. In this paper, we study…

cs.CL2020★ 8 cited

Incorporating Bilingual Dictionaries for Low Resource Semi-Supervised Neural Machine Translation

Sreyashi Nag, Mihir Kale, Varun Lakshminarasimhan +1

We explore ways of incorporating bilingual dictionaries to enable semi-supervised neural machine translation. Conventional back-translation methods have shown success in leveraging…

cs.CL2020★ 6 cited

Template Guided Text Generation for Task-Oriented Dialogue

Mihir Kale, Abhinav Rastogi

Virtual assistants such as Google Assistant, Amazon Alexa, and Apple Siri enable users to interact with a large number of services and APIs on the web using natural language. In th…