A Role-Selected Sharing Network for Joint Machine-Human Chatting Handoff and Service Satisfaction Analysis
arXiv:2109.08412
Abstract
Chatbot is increasingly thriving in different domains, however, because of unexpected discourse complexity and training data sparseness, its potential distrust hatches vital apprehension. Recently, Machine-Human Chatting Handoff (MHCH), predicting chatbot failure and enabling human-algorithm collaboration to enhance chatbot quality, has attracted increasing attention from industry and academia. In this study, we propose a novel model, Role-Selected Sharing Network (RSSN), which integrates both dialogue satisfaction estimation and handoff prediction in one multi-task learning framework. Unlike prior efforts in dialog mining, by utilizing local user satisfaction as a bridge, global satisfaction detector and handoff predictor can effectively exchange critical information. Specifically, we decouple the relation and interaction between the two tasks by the role information after the shared encoder. Extensive experiments on two public datasets demonstrate the effectiveness of our model.
11 pages, 4 figures, accepted by the main conference of EMNLP 2021
References in corpus (4)
- Conversational AI: The Science Behind the Alexa Prize
- Learning End-to-End Goal-Oriented Dialog with Maximal User Task Success and Minimal Human Agent Use
- Multi-domain Conversation Quality Evaluation via User Satisfaction Estimation
- Time to Transfer: Predicting and Evaluating Machine-Human Chatting Handoff