BiToD: A Bilingual Multi-Domain Dataset For Task-Oriented Dialogue Modeling
arXiv:2106.02787
Abstract
Task-oriented dialogue (ToD) benchmarks provide an important avenue to measure progress and develop better conversational agents. However, existing datasets for end-to-end ToD modeling are limited to a single language, hindering the development of robust end-to-end ToD systems for multilingual countries and regions. Here we introduce BiToD, the first bilingual multi-domain dataset for end-to-end task-oriented dialogue modeling. BiToD contains over 7k multi-domain dialogues (144k utterances) with a large and realistic bilingual knowledge base. It serves as an effective benchmark for evaluating bilingual ToD systems and cross-lingual transfer learning approaches. We provide state-of-the-art baselines under three evaluation settings (monolingual, bilingual, and cross-lingual). The analysis of our baselines in different settings highlights 1) the effectiveness of training a bilingual ToD system compared to two independent monolingual ToD systems, and 2) the potential of leveraging a bilingual knowledge base and cross-lingual transfer learning to improve the system performance under low resource condition.
arXiv comment22 pages
References in corpus (13)
- Decoupled Weight Decay Regularization
- HuggingFace's Transformers: State-of-the-art Natural Language Processing
- Multilingual Denoising Pre-training for Neural Machine Translation
- Building a Conversational Agent Overnight with Dialogue Self-Play
- A Simple Language Model for Task-Oriented Dialogue
- SOLOIST: Building Task Bots at Scale with Transfer Learning and Machine Teaching
- Taskmaster-1: Toward a Realistic and Diverse Dialog Dataset
- Learning End-to-End Goal-Oriented Dialog
- STAR: A Schema-Guided Dialog Dataset for Transfer Learning
- Neural Assistant: Joint Action Prediction, Response Generation, and Latent Knowledge Reasoning
- Dynamic Fusion Network for Multi-Domain End-to-end Task-Oriented Dialog
- Entity-Consistent End-to-end Task-Oriented Dialogue System with KB Retriever
- Conditional Generation and Snapshot Learning in Neural Dialogue Systems