output
20122026
most citedSimple and Deep Graph Convolutional Networks

402 citations

Showing 2021 · cs.CLShow all

30 papers · 2 filters

cs.CL2021★ 6 cited

Simple Contrastive Representation Adversarial Learning for NLP Tasks

Deshui Miao, Jiaqi Zhang, Wenbo Xie +4

Self-supervised learning approach like contrastive learning is attached great attention in natural language processing. It uses pairs of training data augmentations to build a clas…

cs.CL2021★ 3 cited

Leveraging Advantages of Interactive and Non-Interactive Models for Vector-Based Cross-Lingual Information Retrieval

Linlong Xu, Baosong Yang, Xiaoyu Lv +3

Interactive and non-interactive model are the two de-facto standard frameworks in vector-based cross-lingual information retrieval (V-CLIR), which embed queries and documents in sy…

cs.CL2021★ 9 cited

Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments

Yu Zhang, Qingrong Xia, Shilin Zhou +3

Semantic role labeling (SRL) is a fundamental yet challenging task in the NLP community. Recent works of SRL mainly fall into two lines: 1) BIO-based; 2) span-based. Despite ubiqui…

cs.CL2021

GGP: A Graph-based Grouping Planner for Explicit Control of Long Text Generation

Xuming Lin, Shaobo Cui, Zhongzhou Zhao +3

Existing data-driven methods can well handle short text generation. However, when applied to the long-text generation scenarios such as story generation or advertising text generat…

cs.CL2021★ 2 cited

Meta-Learning Adversarial Domain Adaptation Network for Few-Shot Text Classification

ChengCheng Han, Zeqiu Fan, Dongxiang Zhang +3

Meta-learning has emerged as a trending technique to tackle few-shot text classification and achieved state-of-the-art performance. However, existing solutions heavily rely on the…

cs.CL2021★ 2 cited

Transferable Dialogue Systems and User Simulators

Bo-Hsiang Tseng, Yinpei Dai, Florian Kreyssig +1

One of the difficulties in training dialogue systems is the lack of training data. We explore the possibility of creating dialogue data through the interaction between a dialogue s…

cs.CL2021★ 1 cited

Enhanced Universal Dependency Parsing with Automated Concatenation of Embeddings

Xinyu Wang, Zixia Jia, Yong Jiang +1

This paper describes the system used in submission from SHANGHAITECH team to the IWPT 2021 Shared Task. Our system is a graph-based parser with the technique of Automated Concatena…

cs.CL2021

EMOVIE: A Mandarin Emotion Speech Dataset with a Simple Emotional Text-to-Speech Model

Chenye Cui, Yi Ren, Jinglin Liu +4

Recently, there has been an increasing interest in neural speech synthesis. While the deep neural network achieves the state-of-the-art result in text-to-speech (TTS) tasks, how to…

cs.CL2021★ 1 cited

TVDIM: Enhancing Image Self-Supervised Pretraining via Noisy Text Data

Pengda Qin, Yuhong Li, Kefeng Deng +1

Among ubiquitous multimodal data in the real world, text is the modality generated by human, while image reflects the physical world honestly. In a visual understanding application…

cs.CL2021★ 3 cited

Bridging Subword Gaps in Pretrain-Finetune Paradigm for Natural Language Generation

Xin Liu, Baosong Yang, Dayiheng Liu +5

A well-known limitation in pretrain-finetune paradigm lies in its inflexibility caused by the one-size-fits-all vocabulary. This potentially weakens the effect when applying pretra…

cs.CL2021★ 11 cited

You Only Compress Once: Towards Effective and Elastic BERT Compression via Exploit-Explore Stochastic Nature Gradient

Shaokun Zhang, Xiawu Zheng, Chenyi Yang +7

Despite superior performance on various natural language processing tasks, pre-trained models such as BERT are challenged by deploying on resource-constraint devices. Most existing…

cs.CL2021★ 2 cited

Differential Privacy for Text Analytics via Natural Text Sanitization

Xiang Yue, Minxin Du, Tianhao Wang +3

Texts convey sophisticated knowledge. However, texts also convey sensitive information. Despite the success of general-purpose language models and domain-specific mechanisms with d…

cs.CL2021★ 12 cited

Document-level Relation Extraction as Semantic Segmentation

Ningyu Zhang, Xiang Chen, Xin Xie +6

Document-level relation extraction aims to extract relations among multiple entity pairs from a document. Previously proposed graph-based or transformer-based models utilize the en…

cs.CL2021★ 4 cited

Preview, Attend and Review: Schema-Aware Curriculum Learning for Multi-Domain Dialog State Tracking

Yinpei Dai, Hangyu Li, Yongbin Li +4

Existing dialog state tracking (DST) models are trained with dialog data in a random order, neglecting rich structural information in a dataset. In this paper, we propose to use cu…

cs.CL2021★ 1 cited

Learning Relation Alignment for Calibrated Cross-modal Retrieval

Shuhuai Ren, Junyang Lin, Guangxiang Zhao +5

Despite the achievements of large-scale multimodal pre-training approaches, cross-modal retrieval, e.g., image-text retrieval, remains a challenging task. To bridge the semantic ga…

cs.CL2021★ 9 cited

StructuralLM: Structural Pre-training for Form Understanding

Chenliang Li, Bin Bi, Ming Yan +4

Large pre-trained language models achieve state-of-the-art results when fine-tuned on downstream NLP tasks. However, they almost exclusively focus on text-only representation, whil…

cs.CL2021★ 4 cited

Speech2Slot: An End-to-End Knowledge-based Slot Filling from Speech

Pengwei Wang, Xin Ye, Xiaohuan Zhou +2

In contrast to conventional pipeline Spoken Language Understanding (SLU) which consists of automatic speech recognition (ASR) and natural language understanding (NLU), end-to-end S…

cs.CL2021★ 9 cited

Improving Named Entity Recognition by External Context Retrieving and Cooperative Learning

Xinyu Wang, Yong Jiang, Nguyen Bach +4

Recent advances in Named Entity Recognition (NER) show that document-level contexts can significantly improve model performance. In many application scenarios, however, such contex…

cs.CL2021★ 9 cited

Improving Biomedical Pretrained Language Models with Knowledge

Zheng Yuan, Yijia Liu, Chuanqi Tan +2

Pretrained language models have shown success in many natural language processing tasks. Many works explore incorporating knowledge into language models. In the biomedical domain,…

cs.CL2021★ 3 cited

Contextualized Knowledge-aware Attentive Neural Network: Enhancing Answer Selection with Knowledge

Yang Deng, Yuexiang Xie, Yaliang Li +3

Answer selection, which is involved in many natural language processing applications such as dialog systems and question answering (QA), is an important yet challenging task in pra…

cs.CL2021★ 19 cited

Probing BERT in Hyperbolic Spaces

Boli Chen, Yao Fu, Guangwei Xu +4

Recently, a variety of probing tasks are proposed to discover linguistic properties learned in contextualized word embeddings. Many of these works implicitly assume these embedding…

cs.CL2021★ 5 cited

Pre-training for Spoken Language Understanding with Joint Textual and Phonetic Representation Learning

Qian Chen, Wen Wang, Qinglin Zhang

In the traditional cascading architecture for spoken language understanding (SLU), it has been observed that automatic speech recognition errors could be detrimental to the perform…

cs.CL2021★ 8 cited

Discriminative Self-training for Punctuation Prediction

Qian Chen, Wen Wang, Mengzhe Chen +1

Punctuation prediction for automatic speech recognition (ASR) output transcripts plays a crucial role for improving the readability of the ASR transcripts and for improving the per…

cs.CL2021★ 7 cited

Mask Attention Networks: Rethinking and Strengthen Transformer

Zhihao Fan, Yeyun Gong, Dayiheng Liu +6

Transformer is an attention-based neural network, which consists of two sublayers, namely, Self-Attention Network (SAN) and Feed-Forward Network (FFN). Existing research explores t…