9 papers · 1 filter
Think Socially via Cognitive Reasoning
Jinfeng Zhou, Zheyu Chen, Shuai Wang +4
LLMs trained for logical reasoning excel at step-by-step deduction to reach verifiable answers. However, this paradigm is ill-suited for navigating social situations, which induce…
SocialSim: Towards Socialized Simulation of Emotional Support Conversation
Zhuang Chen, Yaru Cao, Guanqun Bi +6
Emotional support conversation (ESC) helps reduce people's psychological stress and provide emotional value through interactive dialogues. Due to the high cost of crowdsourcing a l…
SocialEval: Evaluating Social Intelligence of Large Language Models
Jinfeng Zhou, Yuxuan Chen, Yihan Shi +13
LLMs exhibit promising Social Intelligence (SI) in modeling human behavior, raising the need to evaluate LLMs' SI and their discrepancy with humans. SI equips humans with interpers…
HPSS: Heuristic Prompting Strategy Search for LLM Evaluators
Bosi Wen, Pei Ke, Yufei Sun +6
Since the adoption of large language models (LLMs) for text evaluation has become increasingly prevalent in the field of natural language processing (NLP), a series of existing wor…
Crisp: Cognitive Restructuring of Negative Thoughts through Multi-turn Supportive Dialogues
Jinfeng Zhou, Yuxuan Chen, Jianing Yin +9
Cognitive Restructuring (CR) is a psychotherapeutic process aimed at identifying and restructuring an individual's negative thoughts, arising from mental health challenges, into mo…
CharacterBench: Benchmarking Character Customization of Large Language Models
Jinfeng Zhou, Yongkang Huang, Bosi Wen +13
Character-based dialogue (aka role-playing) enables users to freely customize characters for interaction, which often relies on LLMs, raising the need to evaluate LLMs' character c…