activity
20152023
most citedA Survey of Large Language Models

1.5k citations · 1.8k across the 32 of their papers we have counts for

collaborators
Showing 2022Show all

9 papers · 1 filter

cs.CL2022

TextBox 2.0: A Text Generation Library with Pre-trained Language Models

Tianyi Tang, Junyi Li, Zhipeng Chen +9

To facilitate research on text generation, this paper presents a comprehensive and unified library, TextBox 2.0, focusing on the use of pre-trained language models (PLMs). To be co…

cs.CL2022

Tapping the Potential of Coherence and Syntactic Features in Neural Models for Automatic Essay Scoring

Xinying Qiu, Shuxuan Liao, Jiajun Xie +1

In the prompt-specific holistic score prediction task for Automatic Essay Scoring, the general approaches include pre-trained neural model, coherence model, and hybrid model that i…

cs.CL2022

ELMER: A Non-Autoregressive Pre-trained Language Model for Efficient and Effective Text Generation

Junyi Li, Tianyi Tang, Wayne Xin Zhao +2

We study the text generation task under the approach of pre-trained language models (PLMs). Typically, an auto-regressive (AR) method is adopted for generating texts in a token-by-…

cs.IR2022★ 8 cited

From Easy to Hard: A Dual Curriculum Learning Framework for Context-Aware Document Ranking

Yutao Zhu, Jian-Yun Nie, Yixuan Su +3

Contextual information in search sessions is important for capturing users' search intents. Various approaches have been proposed to model user behavior sequences to improve docume…

cs.CL2022★ 2 cited

PReGAN: Answer Oriented Passage Ranking with Weakly Supervised GAN

Pan Du, Jian-Yun Nie, Yutao Zhu +3

Beyond topical relevance, passage ranking for open-domain factoid question answering also requires a passage to contain an answer (answerability). While a few recent studies have i…

cs.CR2022★ 30 cited

A Customized Text Sanitization Mechanism with Differential Privacy

Huimin Chen, Fengran Mo, Yanhao Wang +4

As privacy issues are receiving increasing attention within the Natural Language Processing (NLP) community, numerous methods have been proposed to sanitize texts subject to differ…

cs.SD2022

Self-supervised Context-aware Style Representation for Expressive Speech Synthesis

Yihan Wu, Xi Wang, Shaofei Zhang +3

Expressive speech synthesis, like audiobook synthesis, is still challenging for style representation learning and prediction. Deriving from reference audio or predicting style tags…

cs.CL2022★ 1 cited

Learning to Transfer Prompts for Text Generation

Junyi Li, Tianyi Tang, Jian-Yun Nie +2

Pretrained language models (PLMs) have made remarkable progress in text generation tasks via fine-tuning. While, it is challenging to fine-tune PLMs in a data-scarce situation. The…

cs.CL2022★ 66 cited

Pretrained Language Models for Text Generation: A Survey

Junyi Li, Tianyi Tang, Wayne Xin Zhao +2

Text Generation aims to produce plausible and readable text in a human language from input data. The resurgence of deep learning has greatly advanced this field, in particular, wit…