19 citations · 94 across the 23 of their papers we have counts for
15 papers · 1 filter
Sudowoodo: a Chinese Lyric Imitation System with Source Lyrics
Yongzhu Chang, Rongsheng Zhang, Lin Jiang +3
Lyrics generation is a well-known application in natural language generation research, with several previous studies focusing on generating accurate lyrics using precise control su…
I-WAS: a Data Augmentation Method with GPT-2 for Simile Detection
Yongzhu Chang, Rongsheng Zhang, Jiashu Pu
Simile detection is a valuable task for many natural language processing (NLP)-based applications, particularly in the field of literature. However, existing research on simile det…
PromptNER: Prompt Locating and Typing for Named Entity Recognition
Yongliang Shen, Zeqi Tan, Shuhui Wu +5
Prompt learning is a new paradigm for utilizing pre-trained language models and has achieved great success in many tasks. To adopt prompt learning in the NER task, two kinds of met…
Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured Representations
Yufeng Huang, Jiji Tang, Zhuo Chen +8
Large-scale vision-language pre-training has achieved significant performance in multi-modal understanding and generation tasks. However, existing methods often perform poorly on i…
Tailoring Language Generation Models under Total Variation Distance
Haozhe Ji, Pei Ke, Zhipeng Hu +2
The standard paradigm of neural language generation adopts maximum likelihood estimation (MLE) as the optimizing method. From a distributional view, MLE in fact minimizes the Kullb…
Generating Coherent Narratives by Learning Dynamic and Discrete Entity States with a Contrastive Framework
Jian Guan, Zhenyu Yang, Rongsheng Zhang +2
Despite advances in generating fluent texts, existing pretraining models tend to attach incoherent event sequences to involved entities when generating narratives such as stories a…
Probing Simile Knowledge from Pre-trained Language Models
Weijie Chen, Yongzhu Chang, Rongsheng Zhang +6
Simile interpretation (SI) and simile generation (SG) are challenging tasks for NLP because models require adequate world knowledge to produce predictions. Previous works have empl…
LaMemo: Language Modeling with Look-Ahead Memory
Haozhe Ji, Rongsheng Zhang, Zhenyu Yang +2
Although Transformers with fully connected self-attentions are powerful to model long-term dependencies, they are struggling to scale to long texts with thousands of words in langu…
DecBERT: Enhancing the Language Understanding of BERT with Causal Attention Masks
Ziyang Luo, Yadong Xi, Jing Ma +4
Since 2017, the Transformer-based models play critical roles in various downstream Natural Language Processing tasks. However, a common limitation of the attention mechanism utiliz…
I-Tuning: Tuning Frozen Language Models with Image for Lightweight Image Captioning
Ziyang Luo, Zhipeng Hu, Yadong Xi +2
Image Captioning is a traditional vision-and-language task that aims to generate the language description of an image. Recent studies focus on scaling up the model size and the num…
Youling: an AI-Assisted Lyrics Creation System
Rongsheng Zhang, Xiaoxi Mao, Le Li +6
Recently, a variety of neural models have been proposed for lyrics generation. However, most previous work completes the generation process in a single pass with little human inter…
Unsupervised Domain Adaptation with Adapter
Rongsheng Zhang, Yinhe Zheng, Xiaoxi Mao +1
Unsupervised domain adaptation (UDA) with pre-trained language models (PrLM) has achieved promising results since these pre-trained models embed generic knowledge learned from vari…
Stylized Dialogue Response Generation Using Stylized Unpaired Texts
Yinhe Zheng, Zikai Chen, Rongsheng Zhang +3
Generating stylized responses is essential to build intelligent and engaging dialogue systems. However, this task is far from well-explored due to the difficulties of rendering a p…
Dialogue Distillation: Open-Domain Dialogue Augmentation Using Unpaired Data
Rongsheng Zhang, Yinhe Zheng, Jianzhi Shao +3
Recent advances in open-domain dialogue systems rely on the success of neural models that are trained on large-scale data. However, collecting large-scale dialogue data is usually…
A Pre-training Based Personalized Dialogue Generation Model with Persona-sparse Data
Yinhe Zheng, Rongsheng Zhang, Xiaoxi Mao +1
Endowing dialogue systems with personas is essential to deliver more human-like conversations. However, this problem is still far from well explored due to the difficulties of both…