activity
20222025
most citedKoLA: Carefully Benchmarking World Knowledge of Large Language Models

24 citations · 58 across the 15 of their papers we have counts for

collaborators

15 papers

cs.CL2025

EventSum: A Large-Scale Event-Centric Summarization Dataset for Chinese Multi-News Documents

Mengna Zhu, Kaisheng Zeng, Mao Wang +4

In real life, many dynamic events, such as major disasters and large-scale sports events, evolve continuously over time. Obtaining an overview of these events can help people quick…

cs.CL2024★ 4 cited

LLMAEL: Large Language Models are Good Context Augmenters for Entity Linking

Amy Xin, Yunjia Qi, Zijun Yao +5

Specialized entity linking (EL) models are well-trained at mapping mentions to unique knowledge base (KB) entities according to a given context. However, specialized EL models stru…

cs.CL2024★ 1 cited

CMNEE: A Large-Scale Document-Level Event Extraction Dataset based on Open-Source Chinese Military News

Mengna Zhu, Zijie Xu, Kaisheng Zeng +4

Extracting structured event knowledge, including event triggers and corresponding arguments, from military texts is fundamental to many applications, such as intelligence analysis…

cs.CL2024

Event-level Knowledge Editing

Hao Peng, Xiaozhi Wang, Chunyang Li +5

Knowledge editing aims at updating knowledge of large language models (LLMs) to prevent them from becoming outdated. Existing work edits LLMs at the level of factual knowledge trip…

cs.CL2023★ 5 cited

When does In-context Learning Fall Short and Why? A Study on Specification-Heavy Tasks

Hao Peng, Xiaozhi Wang, Jianhui Chen +8

In-context learning (ICL) has become the default method for using large language models (LLMs), making the exploration of its limitations and understanding the underlying causes cr…

cs.CL2023

MAVEN-Arg: Completing the Puzzle of All-in-One Event Understanding Dataset with Event Argument Annotation

Xiaozhi Wang, Hao Peng, Yong Guan +9

Understanding events in texts is a core objective of natural language understanding, which requires detecting event occurrences, extracting event arguments, and analyzing inter-eve…

cs.CL2023★ 1 cited

Mastering the Task of Open Information Extraction with Large Language Models and Consistent Reasoning Environment

Ji Qi, Kaixuan Ji, Xiaozhi Wang +5

Open Information Extraction (OIE) aims to extract objective structured knowledge from natural texts, which has attracted growing attention to build dedicated models with human expe…

cs.CL2023

OmniEvent: A Comprehensive, Fair, and Easy-to-Use Toolkit for Event Understanding

Hao Peng, Xiaozhi Wang, Feng Yao +5

Event understanding aims at understanding the content and relationship of events within texts, which covers multiple complicated information extraction tasks: event detection, even…

cs.CL2023

The Devil is in the Details: On the Pitfalls of Event Extraction Evaluation

Hao Peng, Xiaozhi Wang, Feng Yao +5

Event extraction (EE) is a crucial task aiming at extracting events from texts, which includes two subtasks: event detection (ED) and event argument extraction (EAE). In this paper…

cs.CL2023★ 24 cited

KoLA: Carefully Benchmarking World Knowledge of Large Language Models

Jifan Yu, Xiaozhi Wang, Shangqing Tu +32

The unprecedented performance of large language models (LLMs) necessitates improvements in evaluations. Rather than merely exploring the breadth of LLM abilities, we believe meticu…

cs.CL2023★ 21 cited

Benchmarking Foundation Models with Language-Model-as-an-Examiner

Yushi Bai, Jiahao Ying, Yixin Cao +10

Numerous benchmarks have been established to assess the performance of foundation models on open-ended question answering, which serves as a comprehensive test of a model's ability…

cs.CL2023

Preserving Knowledge Invariance: Rethinking Robustness Evaluation of Open Information Extraction

Ji Qi, Chuchun Zhang, Xiaozhi Wang +8

The robustness to distribution changes ensures that NLP models can be successfully applied in the realistic world, especially for information extraction tasks. However, most prior…

cs.CL2022

Step out of KG: Knowledge Graph Completion via Knowledgeable Retrieval and Reading Comprehension

Xin Lv, Yankai Lin, Zijun Yao +4

Knowledge graphs, as the cornerstone of many AI applications, usually face serious incompleteness problems. In recent years, there have been many efforts to study automatic knowled…

cs.CL2022★ 2 cited

ConstGCN: Constrained Transmission-based Graph Convolutional Networks for Document-level Relation Extraction

Ji Qi, Bin Xu, Kaisheng Zeng +5

Document-level relation extraction with graph neural networks faces a fundamental graph construction gap between training and inference - the golden graph structure only available…

cs.CL2022

Interactive Contrastive Learning for Self-supervised Entity Alignment

Kaisheng Zeng, Zhenhao Dong, Lei Hou +6

Self-supervised entity alignment (EA) aims to link equivalent entities across different knowledge graphs (KGs) without seed alignments. The current SOTA self-supervised EA method d…