If I Hear You Correctly: Building and Evaluating Interview Chatbots with Active Listening Skills
arXiv:2002.01862 · doi:10.1145/3313831.3376131
Abstract
Interview chatbots engage users in a text-based conversation to draw out their views and opinions. It is, however, challenging to build effective interview chatbots that can handle user free-text responses to open-ended questions and deliver engaging user experience. As the first step, we are investigating the feasibility and effectiveness of using publicly available, practical AI technologies to build effective interview chatbots. To demonstrate feasibility, we built a prototype scoped to enable interview chatbots with a subset of active listening skills - the abilities to comprehend a user's input and respond properly. To evaluate the effectiveness of our prototype, we compared the performance of interview chatbots with or without active listening skills on four common interview topics in a live evaluation with 206 users. Our work presents practical design implications for building effective interview chatbots, hybrid chatbot platforms, and empathetic chatbots beyond interview tasks.
Working draft. To appear in the ACM CHI Conference on Human Factors in Computing Systems (CHI 2020)
References in corpus (6)
Cited by in corpus (15)
- UX Research on Conversational Human-AI Interaction: A Literature Review of the ACM Digital Library
- Towards User-Centric Guidelines for Chatbot Conversational Design
- Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Data
- Evaluating the Experience of LGBTQ+ People Using Large Language Model Based Chatbots for Mental Health Support
- Designing Effective Interview Chatbots: Automatic Chatbot Profiling and Design Suggestion Generation for Chatbot Debugging
- Inform the uninformed: Improving Online Informed Consent Reading with an AI-Powered Chatbot
- Understanding Attitudes and Trust of Generative AI Chatbots for Social Anxiety Support
- Chatbots for Data Collection in Surveys: A Comparison of Four Theory-Based Interview Probes
- Beyond Productivity: Rethinking the Impact of Creativity Support Tools
- AI-Enabled Conversational Journaling for Advancing Parkinson's Disease Symptom Tracking
- Comparing How a Chatbot References User Utterances from Previous Chatting Sessions: An Investigation of Users' Privacy Concerns and Perceptions
- What Does Success Look Like? Catalyzing Meeting Intentionality with AI-Assisted Prospective Reflection
- Democratizing Chatbot Debugging: A Computational Framework for Evaluating and Explaining Inappropriate Chatbot Responses
- Chaplains' Reflections on the Design and Usage of AI for Conversational Care
- The Medical Authority of AI: A Study of AI-enabled Consumer-facing Health Technology