Evaluating Empathetic Chatbots in Customer Service Settings
arXiv:2101.01334
Abstract
Customer service is a setting that calls for empathy in live human agent responses. Recent advances have demonstrated how open-domain chatbots can be trained to demonstrate empathy when responding to live human utterances. We show that a blended skills chatbot model that responds to customer queries is more likely to resemble actual human agent response if it is trained to recognize emotion and exhibit appropriate empathy, than a model without such training. For our analysis, we leverage a Twitter customer service dataset containing several million customer<->agent dialog examples in customer service contexts from 20 well-known brands.
8 pages, 7 figures
References in corpus (8)
- Wizard of Wikipedia: Knowledge-Powered Conversational agents
- Towards a Human-like Open-Domain Chatbot
- The Evolved Transformer
- Personalizing Dialogue Agents: I have a dog, do you have pets too?
- Poly-encoders: Transformer Architectures and Pre-training Strategies for Fast and Accurate Multi-sentence Scoring
- ACUTE-EVAL: Improved Dialogue Evaluation with Optimized Questions and Multi-turn Comparisons
- What makes a good conversation? How controllable attributes affect human judgments
- Dialogue Natural Language Inference