Chaplains' Reflections on the Design and Usage of AI for Conversational Care

Abstract

Despite growing recognition that responsible AI requires domain knowledge, current work on conversational AI primarily draws on clinical expertise that prioritises diagnosis and intervention. However, much of everyday emotional support needs occur in non-clinical contexts, and therefore requires different conversational approaches. We examine how chaplains, who guide individuals through personal crises, grief, and reflection, perceive and engage with conversational AI. We recruited eighteen chaplains to build AI chatbots. While some chaplains viewed chatbots with cautious optimism, the majority expressed limitations of chatbots' ability to support everyday well-being. Our analysis reveals how chaplains perceive their pastoral care duties and areas where AI chatbots fall short, along the themes of Listening, Connecting, Carrying, and Wanting. These themes resonate with the idea of attunement, recently highlighted as a relational lens for understanding the delicate experiences care technologies provide. This perspective informs chatbot design aimed at supporting well-being in non-clinical contexts.

To appear at ACM CHI 2026. 15 pages, 2 figures, 3 tables

References in corpus (20)

• Expressing stigma and inappropriate responses prevents LLMs from safely replacing mental health providers
• If I Hear You Correctly: Building and Evaluating Interview Chatbots with Active Listening Skills
• The Dark Side of AI Companionship: A Taxonomy of Harmful Algorithmic Behaviors in Human-AI Relationships
• MindfulDiary: Harnessing Large Language Model to Support Psychiatric Patients' Journaling
• Evaluating the Experience of LGBTQ+ People Using Large Language Model Based Chatbots for Mental Health Support
• ChaCha: Leveraging Large Language Models to Prompt Children to Share Their Emotions about Personal Events
• From Text to Self: Users' Perceptions of Potential of AI on Interpersonal Communication and Self
• "It's the only thing I can trust": Envisioning Large Language Model Use by Autistic Workers for Communication Assistance
• The Role of AI in Peer Support for Young People: A Study of Preferences for Human- and AI-Generated Responses
• GPTCoach: Towards LLM-Based Physical Activity Coaching
• A Piece of Theatre: Investigating How Teachers Design LLM Chatbots to Assist Adolescent Cyberbullying Education
• A Taxonomy of Linguistic Expressions That Contribute To Anthropomorphism of Language Technologies
• EmoWear: Exploring Emotional Teasers for Voice Message Interaction on Smartwatches
• Mitigating Response Delays in Free-Form Conversations with LLM-powered Intelligent Virtual Agents
• Comparing How a Chatbot References User Utterances from Previous Chatting Sessions: An Investigation of Users' Privacy Concerns and Perceptions
• The Dilemma of Building Do-It-Yourself (DIY) Solutions for Workplace Accessibility
• Beyond Words: Infusing Conversational Agents with Human-like Typing Behaviors
• The Impact of a Chatbot's Ephemerality-Framing on Self-Disclosure Perceptions
• Design Patterns for the Common Good: Building Better Technologies Using the Wisdom of Virtue Ethics
• Remini: Leveraging Chatbot-Mediated Mutual Reminiscence for Promoting Positive Affect and Feeling of Connectedness among Loved Ones