8 papers
LLUMI: Improving LLM Writing Assistance for Mental Health Support with Online Community Feedback
Jiwon Kim, Maya Ajit, Sherry Gong +4
Large language models (LLMs) show promise in generating supportive responses for mental health queries, but improving their usefulness, empathy, and safety often requires substanti…
Towards Error-Free EHRs: Reasoning-Intensive Consistency Verification Between Clinical Notes and Structured Tables in Electronic Health Records
Yeonsu Kwon, Jiho Kim, Junseong Choi +10
Data consistency between unstructured clinical notes and structured tables in Electronic Health Records (EHRs) is essential for patient safety and clinical decision-making. However…
AI Content Moderation in Therapy Conversations
Jiwon Kim, Claire Wang, Taeung Yoon +2
Large language models (LLMs) are increasingly being used for emotional support. They are also being developed for formal therapy purposes. However, LLMs like ChaptGPT or Llama are…
AI Psychosis: Does Conversational AI Amplify Delusion-Related Language?
Soorya Ram Shimgekar, Vipin Gunda, Jiwon Kim +3
Conversational AI systems are increasingly used for personal reflection and emotional disclosure, raising concerns about their effects on vulnerable users. Recent anecdotal reports…
Being Kind Isn't Always Being Safe: Diagnosing Affective Hallucination in LLMs
Sewon Kim, Jiwon Kim, Seungwoo Shin +4
Large Language Models (LLMs) are increasingly engaged in emotionally vulnerable conversations that extend beyond information seeking to moments of personal distress. As they adopt…
PAIR-SAFE: A Paired-Agent Approach for Runtime Auditing and Refining AI-Mediated Mental Health Support
Jiwon Kim, Violeta J. Rodriguez, Dong Whi Yoo +2
Large language models (LLMs) are increasingly used for mental health support, yet they can produce responses that are overly directive, inconsistent, or clinically misaligned, part…