Comparing How a Chatbot References User Utterances from Previous Chatting Sessions: An Investigation of Users' Privacy Concerns and Perceptions
arXiv:2308.04879 · doi:10.1145/3623809.3623875
Abstract
Chatbots are capable of remembering and referencing previous conversations, but does this enhance user engagement or infringe on privacy? To explore this trade-off, we investigated the format of how a chatbot references previous conversations with a user and its effects on a user's perceptions and privacy concerns. In a three-week longitudinal between-subjects study, 169 participants talked about their dental flossing habits to a chatbot that either, (1-None): did not explicitly reference previous user utterances, (2-Verbatim): referenced previous utterances verbatim, or (3-Paraphrase): used paraphrases to reference previous utterances. Participants perceived Verbatim and Paraphrase chatbots as more intelligent and engaging. However, the Verbatim chatbot also raised privacy concerns with participants. To gain insights as to why people prefer certain conditions or had privacy concerns, we conducted semi-structured interviews with 15 participants. We discuss implications from our findings that can help designers choose an appropriate format to reference previous user utterances and inform in the design of longitudinal dialogue scripting.
arXiv comment10 pages, 3 figures, to be published in Proceedings of the 11th International Conference on Human-Agent Interaction (ACM HAI'23)
References in corpus (7)
- How should my chatbot interact? A survey on human-chatbot interaction design
- Tell Me About Yourself: Using an AI-Powered Chatbot to Conduct Conversational Surveys with Open-ended Questions
- Conceptual Metaphors Impact Perceptions of Human-AI Collaboration
- If I Hear You Correctly: Building and Evaluating Interview Chatbots with Active Listening Skills
- UX Research on Conversational Human-AI Interaction: A Literature Review of the ACM Digital Library
- Chatbots language design: the influence of language variation on user experience
- Keep Me Updated! Memory Management in Long-term Conversations
Cited by in corpus (4)
- The Impact of a Chatbot's Ephemerality-Framing on Self-Disclosure Perceptions
- Improving Public Service Chatbot Design and Civic Impact: Investigation of Citizens' Perceptions of a Metro City 311 Chatbot
- Chaplains' Reflections on the Design and Usage of AI for Conversational Care
- Polite But Boring? Trade-offs Between Engagement and Psychological Reactance to Chatbot Feedback Styles