activity
20162023
most citedExploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

3.7k citations · 8.3k across the 22 of their papers we have counts for

collaborators
Showing 2022Show all

5 papers · 1 filter

cs.CL2022

Improving the Robustness of Summarization Models by Detecting and Removing Input Noise

Kundan Krishna, Yao Zhao, Jie Ren +4

The evaluation of abstractive summarization models typically uses test data that is identically distributed as training data. In real-world practice, documents to be summarized may…

cs.CL2022★ 38 cited

Calibrating Sequence likelihood Improves Conditional Language Generation

Yao Zhao, Misha Khalman, Rishabh Joshi +3

Conditional language models are predominantly trained with maximum likelihood estimation (MLE), giving probability mass to sparsely observed target sequences. While MLE trained mod…

cs.CL2022★ 12 cited

Out-of-Distribution Detection and Selective Generation for Conditional Language Models

Jie Ren, Jiaming Luo, Yao Zhao +4

Machine learning algorithms typically assume independent and identically distributed samples in training and at test time. Much work has shown that high-performing ML classifiers c…

cs.CL2022★ 4 cited

Investigating Efficiently Extending Transformers for Long Input Summarization

Jason Phang, Yao Zhao, Peter J. Liu

While large pretrained Transformer models have proven highly capable at tackling natural language tasks, handling long sequence inputs continues to be a significant challenge. One…

cs.CL2022★ 5 cited

SMART: Sentences as Basic Units for Text Evaluation

Reinald Kim Amplayo, Peter J. Liu, Yao Zhao +1

Widely used evaluation metrics for text generation either do not work well with longer texts or fail to evaluate all aspects of text quality. In this paper, we introduce a new metr…