5 papers · 1 filter
Representational Control over Self-Report & Behavior Coherence in LLM Risk-Taking
Rafal Kocielnik, Peiyang Song, Pengrui Han +4
Self-report is an appealing low-cost probe of an LLM's dispositions, but recent work finds only selective agreement between what models report and how they behave. Prior accounts e…
A Multi-Agent LLM Framework for Rating the Quality of Surgical Feedback
Rafal Kocielnik, J. Everett Knudsen, Steven Y. Cen +7
Verbal feedback delivered by attending surgeons in the operating room plays a critical formative role in resident trainee skill acquisition. Yet, assessing the quality of trainer f…
Prosocial Behavior Detection in Player Game Chat: From Aligning Human-AI Definitions to Efficient Annotation at Scale
Rafal Kocielnik, Min Kim, Penphob +5
Detecting prosociality in text--communication intended to affirm, support, or improve others' behavior--is a novel and increasingly important challenge for trust and safety systems…
Self-Anchored Attention Model for Sample-Efficient Classification of Prosocial Text Chat
Zhuofang Li, Rafal Kocielnik, Fereshteh Soltani +4
Millions of players engage daily in competitive online games, communicating through in-game chat. Prior research has focused on detecting relatively small volumes of toxic content…
Context-Aware Toxicity Detection in Multiplayer Games: Integrating Domain-Adaptive Pretraining and Match Metadata
Adrien Schurger-Foy, Rafal Dariusz Kocielnik, Caglar Gulcehre +1
The detrimental effects of toxicity in competitive online video games are widely acknowledged, prompting publishers to monitor player chat conversations. This is challenging due to…