activity
20182024
most citedERNIE: Enhanced Language Representation with Informative Entities

135 citations · 300 across the 22 of their papers we have counts for

collaborators
Showing cs.CLShow all

24 papers · 1 filter

cs.CL20221 cited

MAVEN-ERE: A Unified Large-scale Dataset for Event Coreference, Temporal, Causal, and Subevent Relation Extraction

Xiaozhi Wang, Yulin Chen, Ning Ding +9

The diverse relationships among real-world events, including coreference, temporal, causal, and subevent relations, are fundamental to understanding natural languages. However, two…

cs.CL2022

Exploring Mode Connectivity for Pre-trained Language Models

Yujia Qin, Cheng Qian, Jing Yi +6

Recent years have witnessed the prevalent application of pre-trained language models (PLMs) in NLP. From the perspective of parameter space, PLMs provide generic initialization, st…

cs.CL20222 cited

Different Tunes Played with Equal Skill: Exploring a Unified Optimization Subspace for Delta Tuning

Jing Yi, Weize Chen, Yujia Qin +6

Delta tuning (DET, also known as parameter-efficient tuning) is deemed as the new paradigm for using pre-trained language models (PLMs). Up to now, various DETs with distinct desig…

cs.CL202144 cited

Prompt-Learning for Fine-Grained Entity Typing

Ning Ding, Yulin Chen, Xu Han +6

As an effective approach to tune pre-trained language models (PLMs) for specific tasks, prompt-learning has recently attracted much attention from researchers. By using \textit{clo…

cs.CL202115 cited

CPM-2: Large-scale Cost-effective Pre-trained Language Models

Zhengyan Zhang, Yuxian Gu, Xu Han +16

In recent years, the size of pre-trained language models (PLMs) has grown by leaps and bounds. However, efficiency issues of these large-scale PLMs limit their utilization in real-…

cs.CL2021

CLEVE: Contrastive Pre-training for Event Extraction

Ziqi Wang, Xiaozhi Wang, Xu Han +6

Event extraction (EE) has considerably benefited from pre-trained language models (PLMs) by fine-tuning. However, existing pre-training methods have not involved modeling event cha…