5 papers · 1 filter
NurValues: Real-World Nursing Values Evaluation for Large Language Models in Clinical Context
Ben Yao, Qiuchi Li, Yazhou Zhang +4
While LLMs have demonstrated medical knowledge and conversational ability, their deployment in clinical practice raises new risks: patients may place greater trust in LLM-generated…
Visual Room 2.0: Seeing is Not Understanding for MLLMs
Haokun Li, Yazhou Zhang, Jizhi Ding +2
Can multi-modal large language models (MLLMs) truly understand what they can see? Extending Searle's Chinese Room into the multi-modal domain, this paper proposes the Visual Room a…
Seeing is Not Understanding: A Benchmark on Perception-Cognition Disparities in Large Language Models
Haokun Li, Yazhou Zhang, Jizhi Ding +2
With the rapid advancement of Multimodal Large Language Models (MLLMs), they have demonstrated exceptional capabilities across a variety of vision-language tasks. However, current…
Beyond Single-Sentence Prompts: Upgrading Value Alignment Benchmarks with Dialogues and Stories
Yazhou Zhang, Qimeng Liu, Qiuchi Li +2
Evaluating the value alignment of large language models (LLMs) has traditionally relied on single-sentence adversarial prompts, which directly probe models with ethically sensitive…
Is Sarcasm Detection A Step-by-Step Reasoning Process in Large Language Models?
Ben Yao, Yazhou Zhang, Qiuchi Li +1
Elaborating a series of intermediate reasoning steps significantly improves the ability of large language models (LLMs) to solve complex problems, as such steps would evoke LLMs to…