Understanding the Impact of Long-Term Memory on Self-Disclosure with Large Language Model-Driven Chatbots for Public Health Intervention

Abstract

Recent large language models (LLMs) offer the potential to support public health monitoring by facilitating health disclosure through open-ended conversations but rarely preserve the knowledge gained about individuals across repeated interactions. Augmenting LLMs with long-term memory (LTM) presents an opportunity to improve engagement and self-disclosure, but we lack an understanding of how LTM impacts people's interaction with LLM-driven chatbots in public health interventions. We examine the case of CareCall -- an LLM-driven voice chatbot with LTM -- through the analysis of 1,252 call logs and interviews with nine users. We found that LTM enhanced health disclosure and fostered positive perceptions of the chatbot by offering familiarity. However, we also observed challenges in promoting self-disclosure through LTM, particularly around addressing chronic health conditions and privacy concerns. We discuss considerations for LTM integration in LLM-driven chatbots for public health monitoring, including carefully deciding what topics need to be remembered in light of public health goals.

Accepted to ACM CHI 2024 as a full paper

References in corpus (5)

• Training language models to follow instructions with human feedback
• PaLM: Scaling Language Modeling with Pathways
• Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Data
• Goal-setting And Achievement In Activity Tracking Apps: A Case Study Of MyFitnessPal
• An Evaluation of Generative Pre-Training Model-based Therapy Chatbot for Caregivers

Cited by in corpus (11)

• The Dark Side of AI Companionship: A Taxonomy of Harmful Algorithmic Behaviors in Human-AI Relationships
• ExploreSelf: Fostering User-driven Exploration and Reflection on Personal Challenges with Adaptive Guidance by Large Language Models
• AI on My Shoulder: Supporting Emotional Labor in Front-Office Roles with an LLM-based Empathetic Coworker
• "I've talked to ChatGPT about my issues last night.": Examining Mental Health Conversations with Large Language Models through Reddit Analysis
• DesignFromX: Empowering Consumer-Driven Design Space Exploration through Feature Composition of Referenced Products
• Classroom Simulacra: Building Contextual Student Generative Agents in Online Education for Learning Behavioral Simulation
• AI-Enabled Conversational Journaling for Advancing Parkinson's Disease Symptom Tracking
• The Impact of a Chatbot's Ephemerality-Framing on Self-Disclosure Perceptions
• Toward Natural and Companionable Virtual Agents via Cross-Temporal Emotional Modeling
• From Daily Song to Daily Self: Supporting Reflective Songwriting of Deaf and Hard-of-Hearing Individuals through Generative Music AI
• Fast-Food Intimacy: How Chinese Women Navigate Soul's AI Boyfriend