9 papers · 1 filter
VALCON: Benchmarking and Enhancing Value Consistency in Large Language Models via Dual-Role Variation
Junru Wu, Jingting Zheng, Yuqi Ren +1
Current value alignment evaluations for large language models (LLMs) heavily rely on output compliance, overlooking whether LLMs maintain value consistency when alternating between…
ExpertIVS: Sociological Expert Driven Individual Value Simulation in Large Language Models
Zhen Wang, Yuqi Ren, Yuehan Cui +7
Large Language Model (LLM) agents have demonstrated considerable potential for social simulation, yet struggle to accurately model individual value systems. Most existing methods m…
D2VBench: Benchmarking Large Language Models with Value Dilemmas in Daily Scenarios
Siyi Hao, Yidi Cao, Linhao Yu +2
With the wide application of large language models (LLMs) in real-world scenarios, the value implication of their outputs is crucial. However, existing evaluation benchmarks suffer…
Pancasila-Dilemmas: Evaluating Large Language Models on Indonesian Human Value Dilemmas Grounded in Pancasila
Supryadi, Irfan, Julianti +4
The value alignment of large language models (LLMs) is crucial for ensuring responses align with human intention and value preferences. However, most evaluations of value alignment…
Beyond Value Benchmarks: Measuring Value-Structure Alignment in Large Language Models via Symmetric Q-Sorts
Jingting Zheng, Yuqi Ren, Linhao Yu +2
Large Language Models (LLMs) are increasingly deployed in contexts requiring complex moral reasoning and value trade-offs. However, existing evaluations typically rely on item-leve…
EvoSci: A Bio-Inspired Multi-Agent Framework for the Evolution of Scientific Discovery
Xiaoyu Xiong, Yuqi Ren, Deyi Xiong
Large language models (LLMs), have shown strong potential in scientific discovery, yet existing methods still face substantial challenges in the design of research workflows and mu…
DVMap: Fine-Grained Pluralistic Value Alignment via High-Consensus Demographic-Value Mapping
Pengyun Zhu, Yuqi Ren, Zhen Wang +2
Current Large Language Models (LLMs) typically rely on coarse-grained national labels for pluralistic value alignment. However, such macro-level supervision often obscures intra-co…
DEP: A Decentralized Large Language Model Evaluation Protocol
Jianxiang Peng, Junhao Li, Hongxiang Wang +15
With the rapid development of Large Language Models (LLMs), a large number of benchmarks have been proposed. However, most benchmarks lack unified evaluation standard and require t…
Finding the Translation Switch: Discovering and Exploiting the Task-Initiation Features in LLMs
Xinwei Wu, Heng Liu, Xiaohu Zhao +6
Large Language Models (LLMs) frequently exhibit strong translation abilities, even without task-specific fine-tuning. However, the internal mechanisms governing this innate capabil…