306 citations · 742 across the 41 of their papers we have counts for
41 papers
Unified Text Structuralization with Instruction-tuned Language Models
Xuanfan Ni, Piji Li, Huayang Li
Text structuralization is one of the important fields of natural language processing (NLP) consists of information extraction (IE) and structure formalization. However, current stu…
Ancient Chinese Word Segmentation and Part-of-Speech Tagging Using Distant Supervision
Shuo Feng, Piji Li
Ancient Chinese word segmentation (WSG) and part-of-speech tagging (POS) are important to study ancient Chinese, but the amount of ancient Chinese WSG and POS tagging data is still…
Understanding Social Media Cross-Modality Discourse in Linguistic Space
Chunpu Xu, Hanzhuo Tan, Jing Li +1
The multimedia communications with texts and images are popular on social media. However, limited studies concern how images are structured with texts to form coherent meanings in…
Feature-Level Debiased Natural Language Understanding
Yougang Lyu, Piji Li, Yechang Yang +5
Natural language understanding (NLU) models often rely on dataset biases rather than intended task-relevant features to achieve high performance on specific datasets. As a result,…
A Survey on Backdoor Attack and Defense in Natural Language Processing
Xuan Sheng, Zhaoyang Han, Piji Li +1
Deep learning is becoming increasingly popular in real-life applications, especially in natural language processing (NLP). Users often choose training outsourcing or adopt third-pa…
uChecker: Masked Pretrained Language Models as Unsupervised Chinese Spelling Checkers
Piji Li
The task of Chinese Spelling Check (CSC) is aiming to detect and correct spelling errors that can be found in the text. While manually annotating a high-quality dataset is expensiv…
PromptAttack: Prompt-based Attack for Language Models via Gradient Search
Yundi Shi, Piji Li, Changchun Yin +3
As the pre-trained language models (PLMs) continue to grow, so do the hardware and data requirements for fine-tuning PLMs. Therefore, the researchers have come up with a lighter me…
Effidit: Your AI Writing Assistant
Shuming Shi, Enbo Zhao, Duyu Tang +10
In this technical report, we introduce Effidit (Efficient and Intelligent Editing), a digital writing assistant that facilitates users to write higher-quality text more efficiently…
Parameter-Efficient Tuning by Manipulating Hidden States of Pretrained Language Models For Classification Tasks
Haoran Yang, Piji Li, Wai Lam
Parameter-efficient tuning aims to distill knowledge for downstream tasks by optimizing a few introduced parameters while freezing the pretrained language models (PLMs). Continuous…
Tail-to-Tail Non-Autoregressive Sequence Prediction for Chinese Grammatical Error Correction
Piji Li, Shuming Shi
We investigate the problem of Chinese Grammatical Error Correction (CGEC) and present a new framework named Tail-to-Tail (\textbf{TtT}) non-autoregressive sequence prediction to ad…
Non-Autoregressive Text Generation with Pre-trained Language Models
Yixuan Su, Deng Cai, Yan Wang +4
Non-autoregressive generation (NAG) has recently attracted great attention due to its fast inference speed. However, the generation quality of existing NAG models still lags behind…
Generating Diversified Comments via Reader-Aware Topic Modeling and Saliency Detection
Wei Wang, Piji Li, Hai-Tao Zheng
Automatic comment generation is a special and challenging task to verify the model ability on news content comprehension and language generation. Comments not only convey salient a…
Abstractive Opinion Tagging
Qintong Li, Piji Li, Xinyi Li +3
In e-commerce, opinion tags refer to a ranked list of tags provided by the e-commerce platform that reflect characteristics of reviews of an item. To assist consumers to quickly gr…
Predicting Events in MOBA Games: Prediction, Attribution, and Evaluation
Zelong Yang, Yan Wang, Piji Li +4
The multiplayer online battle arena (MOBA) games have become increasingly popular in recent years. Consequently, many efforts have been devoted to providing pre-game or in-game pre…
Consistency and Coherency Enhanced Story Generation
Wei Wang, Piji Li, Hai-Tao Zheng
Story generation is a challenging task, which demands to maintain consistency of the plots and characters throughout the story. Previous works have shown that GPT2, a large-scale l…
Dialogue Generation on Infrequent Sentence Functions via Structured Meta-Learning
Yifan Gao, Piji Li, Wei Bi +3
Sentence function is an important linguistic feature indicating the communicative purpose in uttering a sentence. Incorporating sentence functions into conversations has shown impr…
Enhancing Dialogue Generation via Multi-Level Contrastive Learning
Xin Li, Piji Li, Yan Wang +2
Most of the existing works for dialogue generation are data-driven models trained directly on corpora crawled from websites. They mainly focus on improving the model architecture t…
Exclusive Hierarchical Decoding for Deep Keyphrase Generation
Wang Chen, Hou Pong Chan, Piji Li +1
Keyphrase generation (KG) aims to summarize the main ideas of a document into a set of keyphrases. A new setting is recently introduced into this problem, in which, given a documen…
Salience Estimation with Multi-Attention Learning for Abstractive Text Summarization
Piji Li, Lidong Bing, Zhongyu Wei +1
Attention mechanism plays a dominant role in the sequence generation models and has been used to improve the performance of machine translation and abstractive text summarization.…
SongNet: Rigid Formats Controlled Text Generation
Piji Li, Haisong Zhang, Xiaojiang Liu +1
Neural text generation has made tremendous progress in various tasks. One common characteristic of most of the tasks is that the texts are not restricted to some rigid formats when…
An Empirical Investigation of Pre-Trained Transformer Language Models for Open-Domain Dialogue Generation
Piji Li
We present an empirical investigation of pre-trained Transformer-based auto-regressive language models for the task of open-domain dialogue generation. Training paradigm of pre-tra…
A Neural Topical Expansion Framework for Unstructured Persona-oriented Dialogue Generation
Minghong Xu, Piji Li, Haoran Yang +4
Unstructured Persona-oriented Dialogue Systems (UPDS) has been demonstrated effective in generating persona consistent responses by utilizing predefined natural language user perso…
Relevance-Promoting Language Model for Short-Text Conversation
Xin Li, Piji Li, Wei Bi +2
Despite the effectiveness of sequence-to-sequence framework on the task of Short-Text Conversation (STC), the issue of under-exploitation of training data (i.e., the supervision si…
Keep it Consistent: Topic-Aware Storytelling from an Image Stream via Iterative Multi-agent Communication
Ruize Wang, Zhongyu Wei, Ying Cheng +5
Visual storytelling aims to generate a narrative paragraph from a sequence of images automatically. Existing approaches construct text description independently for each image and…