Effects of Persuasive Dialogues: Testing Bot Identities and Inquiry Strategies

Abstract

Intelligent conversational agents, or chatbots, can take on various identities and are increasingly engaging in more human-centered conversations with persuasive goals. However, little is known about how identities and inquiry strategies influence the conversation's effectiveness. We conducted an online study involving 790 participants to be persuaded by a chatbot for charity donation. We designed a two by four factorial experiment (two chatbot identities and four inquiry strategies) where participants were randomly assigned to different conditions. Findings showed that the perceived identity of the chatbot had significant effects on the persuasion outcome (i.e., donation) and interpersonal perceptions (i.e., competence, confidence, warmth, and sincerity). Further, we identified interaction effects among perceived identities and inquiry strategies. We discuss the findings for theoretical and practical implications for developing ethical and effective persuasive chatbots. Our published data, codes, and analyses serve as the first step towards building competent ethical persuasive chatbots.

15 pages, 10 figures. Full paper to appear at ACM CHI 2020

Cited by in corpus (10)

• UX Research on Conversational Human-AI Interaction: A Literature Review of the ACM Digital Library
• Towards User-Centric Guidelines for Chatbot Conversational Design
• Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Data
• On LLM Wizards: Identifying Large Language Models' Behaviors for Wizard of Oz Experiments
• Must Read: A Comprehensive Survey of Computational Persuasion
• REALab: An Embedded Perspective on Tampering
• Multi-Agent Systems Shape Social Norms for Prosocial Behavior Change
• Counterfactual Reasoning Using Predicted Latent Personality Dimensions for Optimizing Persuasion Outcome
• Polite But Boring? Trade-offs Between Engagement and Psychological Reactance to Chatbot Feedback Styles
• Refine and Imitate: Reducing Repetition and Inconsistency in Persuasion Dialogues via Reinforcement Learning and Human Demonstration