257 citations · 733 across the 67 of their papers we have counts for
11 papers · 1 filter
CUGE: A Chinese Language Understanding and Generation Evaluation Benchmark
Yuan Yao, Qingxiu Dong, Jian Guan +32
Realizing general-purpose language intelligence has been a longstanding goal for natural language processing, where standard evaluation benchmarks play a fundamental and guiding ro…
Hierarchical Curriculum Learning for AMR Parsing
Peiyi Wang, Liang Chen, Tianyu Liu +4
Abstract Meaning Representation (AMR) parsing aims to translate sentences to semantic representation with a hierarchical structure, and is recently empowered by pretrained sequence…
An Enhanced Span-based Decomposition Method for Few-Shot Sequence Labeling
Peiyi Wang, Runxin Xu, Tianyu Liu +4
Few-Shot Sequence Labeling (FSSL) is a canonical paradigm for the tagging models, e.g., named entity recognition and slot filling, to generalize on an emerging, resource-scarce dom…
Behind the Scenes: An Exploration of Trigger Biases Problem in Few-Shot Event Classification
Peiyi Wang, Runxin Xu, Tianyu Liu +3
Few-Shot Event Classification (FSEC) aims at developing a model for event prediction, which can generalize to new event types with a limited number of annotated data. Existing FSEC…
Explicit Interaction Network for Aspect Sentiment Triplet Extraction
Peiyi Wang, Tianyu Liu, Damai Dai +3
Aspect Sentiment Triplet Extraction (ASTE) aims to recognize targets, their sentiment polarities and opinions explaining the sentiment from a sentence. ASTE could be naturally divi…
CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark
Ningyu Zhang, Mosha Chen, Zhen Bi +20
Artificial Intelligence (AI), along with the recent progress in biomedical language understanding, is gradually changing medical practice. With the development of biomedical langua…
Problems and Countermeasures in Natural Language Processing Evaluation
Qingxiu Dong, Zhifang Sui, Weidong Zhan +1
Evaluation in natural language processing guides and promotes research on models and methods. In recent years, new evalua-tion data sets and evaluation tasks have been continuously…
A Token-level Reference-free Hallucination Detection Benchmark for Free-form Text Generation
Tianyu Liu, Yizhe Zhang, Chris Brockett +4
Large pretrained generative models like GPT-3 often suffer from hallucinating non-existent or incorrect content, which undermines their potential merits in real applications. Exist…
Knowledge Neurons in Pretrained Transformers
Damai Dai, Li Dong, Yaru Hao +3
Large-scale pretrained language models are surprisingly good at recalling factual knowledge presented in the training corpus. In this paper, we present preliminary studies on how f…
Incorporating Connections Beyond Knowledge Embeddings: A Plug-and-Play Module to Enhance Commonsense Reasoning in Machine Reading Comprehension
Damai Dai, Hua Zheng, Zhifang Sui +1
Conventional Machine Reading Comprehension (MRC) has been well-addressed by pattern matching, but the ability of commonsense reasoning remains a gap between humans and machines. Pr…
Towards Faithfulness in Open Domain Table-to-text Generation from an Entity-centric View
Tianyu Liu, Xin Zheng, Baobao Chang +1
In open domain table-to-text generation, we notice that the unfaithful generation usually contains hallucinated content which can not be aligned to any input table record. We thus…