5 papers
Beyond Final Decisions: A Process-Centric Benchmark for Transparent AI-Assisted Peer Review
Siming Yuan, Xueyi Zhang, Wangze Ni +7
Peer review is central to quality control in science. However, existing evaluations of AI-assisted peer review mainly focus on the overall quality of generated reviews or the accur…
Beyond Local vs. External: A Game-Theoretic Framework for Trustworthy Knowledge Acquisition
Rujing Yao, Yufei Shi, Yang Wu +5
Cloud-hosted Large Language Models (LLMs) offer unmatched reasoning capabilities and dynamic knowledge, yet submitting raw queries to these external services risks exposing sensiti…
EpiPersona: Persona Projection and Episode Coupling for Pluralistic Preference Modeling
Yujie Zhang, Weikang Yuan, Zhuoren Jiang +1
Pluralistic alignment is essential for adapting large language models (LLMs) to the diverse preferences of individuals and minority groups. However, existing personalized reward mo…
AlignSurvey: A Comprehensive Benchmark for Human Preferences Alignment in Social Surveys
Chenxi Lin, Weikang Yuan, Zhuoren Jiang +5
Understanding human attitudes, preferences, and behaviors through social surveys is essential for academic research and policymaking. Yet traditional surveys face persistent challe…
LeCoDe: A Benchmark Dataset for Interactive Legal Consultation Dialogue Evaluation
Weikang Yuan, Kaisong Song, Zhuoren Jiang +6
Legal consultation is essential for safeguarding individual rights and ensuring access to justice, yet remains costly and inaccessible to many individuals due to the shortage of pr…