Towards Explainable Conversational Recommender Systems

Abstract

Explanations in conventional recommender systems have demonstrated benefits in helping the user understand the rationality of the recommendations and improving the system's efficiency, transparency, and trustworthiness. In the conversational environment, multiple contextualized explanations need to be generated, which poses further challenges for explanations. To better measure explainability in conversational recommender systems (CRS), we propose ten evaluation perspectives based on concepts from conventional recommender systems together with the characteristics of CRS. We assess five existing CRS benchmark datasets using these metrics and observe the necessity of improving the explanation quality of CRS. To achieve this, we conduct manual and automatic approaches to extend these dialogues and construct a new CRS dataset, namely Explainable Recommendation Dialogues (E-ReDial). It includes 756 dialogues with over 2,000 high-quality rewritten explanations. We compare two baseline approaches to perform explanation generation based on E-ReDial. Experimental results suggest that models trained on E-ReDial can significantly improve explainability while introducing knowledge into the models can further improve the performance. GPT-3 in the in-context learning setting can generate more realistic and diverse movie descriptions. In contrast, T5 training on E-ReDial can better generate clear reasons for recommendations based on user preferences. E-ReDial is available at https://github.com/Superbooming/E-ReDial.

References in corpus (12)

• Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
• Scaling Instruction-Finetuned Language Models
• Explainable Recommendation: A Survey and New Perspectives
• A Survey on Conversational Recommender Systems
• Neural Rating Regression with Abstractive Tips Generation for Recommendation
• Counterfactual Explainable Recommendation
• Neural Interactive Collaborative Filtering
• Counterfactual Explanations for Neural Recommenders
• Simulating User Satisfaction for the Evaluation of Task-oriented Dialogue Systems
• Do Social Explanations Work? Studying and Modeling the Effects of Social Explanations in Recommender Systems
• Measuring "Why" in Recommender Systems: a Comprehensive Survey on the Evaluation of Explainable Recommendation
• EGCR: Explanation Generation for Conversational Recommendation

Cited by in corpus (4)

• Rethinking the Evaluation for Conversational Recommendation in the Era of Large Language Models
• Less is More: Towards Sustainability-Aware Persuasive Explanations in Recommender Systems
• Review-driven Personalized Preference Reasoning with Large Language Models for Recommendation
• Rethinking the Evaluation of Dialogue Systems: Effects of User Feedback on Crowdworkers and LLMs