94 citations · 404 across the 53 of their papers we have counts for
6 papers · 1 filter
DecBERT: Enhancing the Language Understanding of BERT with Causal Attention Masks
Ziyang Luo, Yadong Xi, Jing Ma +4
Since 2017, the Transformer-based models play critical roles in various downstream Natural Language Processing tasks. However, a common limitation of the attention mechanism utiliz…
Youling: an AI-Assisted Lyrics Creation System
Rongsheng Zhang, Xiaoxi Mao, Le Li +6
Recently, a variety of neural models have been proposed for lyrics generation. However, most previous work completes the generation process in a single pass with little human inter…
LOT: A Story-Centric Benchmark for Evaluating Chinese Long Text Understanding and Generation
Jian Guan, Zhuoer Feng, Yamei Chen +4
Standard multi-task benchmarks are essential for developing pretraining models that can generalize to various downstream tasks. Existing benchmarks for natural language processing…
Long Text Generation by Modeling Sentence-Level and Discourse-Level Coherence
Jian Guan, Xiaoxi Mao, Changjie Fan +3
Generating long and coherent text is an important but challenging task, particularly for open-ended language generation tasks such as story generation. Despite the success in model…
OpenMEVA: A Benchmark for Evaluating Open-ended Story Generation Metrics
Jian Guan, Zhexin Zhang, Zhuoer Feng +5
Automatic metrics are essential for developing natural language generation (NLG) models, particularly for open-ended language generation tasks such as story generation. However, ex…
Easy and Efficient Transformer : Scalable Inference Solution For large NLP model
Gongzheng Li, Yadong Xi, Jingzhen Ding +5
Recently, large-scale transformer-based models have been proven to be effective over various tasks across many domains. Nevertheless, applying them in industrial production require…