7 papers · 1 filter
Curse of Knowledge: When Complex Evaluation Context Benefits yet Biases LLM Judges
Weiyuan Li, Xintao Wang, Siyu Yuan +5
As large language models (LLMs) grow more capable, they face increasingly diverse and complex tasks, making reliable evaluation challenging. The paradigm of LLMs as judges has emer…
CoSER: A Comprehensive Literary Dataset and Framework for Training and Evaluating LLM Role-Playing and Persona Simulation
Xintao Wang, Heng Wang, Yifei Zhang +9
Role-playing language agents (RPLAs) have emerged as promising applications of large language models (LLMs). However, simulating established characters presents a challenging task…
Capturing Minds, Not Just Words: Enhancing Role-Playing Language Models with Personality-Indicative Data
Yiting Ran, Xintao Wang, Rui Xu +4
Role-playing agents (RPA) have been a popular application area for large language models (LLMs), attracting significant interest from both industry and academia.While existing RPAs…
SurveyAgent: A Conversational System for Personalized and Efficient Research Survey
Xintao Wang, Jiangjie Chen, Nianqi Li +6
In the rapidly advancing research fields such as AI, managing and staying abreast of the latest scientific literature has become a significant challenge for researchers. Although p…
From Persona to Personalization: A Survey on Role-Playing Language Agents
Jiangjie Chen, Xintao Wang, Rui Xu +15
Recent advancements in large language models (LLMs) have significantly boosted the rise of Role-Playing Language Agents (RPLAs), i.e., specialized AI systems designed to simulate a…
Evaluating Character Understanding of Large Language Models via Character Profiling from Fictional Works
Xinfeng Yuan, Siyu Yuan, Yuhan Cui +5
Large language models (LLMs) have demonstrated impressive performance and spurred numerous AI applications, in which role-playing agents (RPAs) are particularly popular, especially…