The Eighth Dialog System Technology Challenge
arXiv:1911.06394
Abstract
This paper introduces the Eighth Dialog System Technology Challenge. In line with recent challenges, the eighth edition focuses on applying end-to-end dialog technologies in a pragmatic way for multi-domain task-completion, noetic response selection, audio visual scene-aware dialog, and schema-guided dialog state tracking tasks. This paper describes the task definition, provided datasets, and evaluation set-up for each track. We also summarize the results of the submitted systems to highlight the overall trends of the state-of-the-art technologies for the tasks.
Submitted to NeurIPS 2019 3rd Conversational AI Workshop
References in corpus (6)
- XLNet: Generalized Autoregressive Pretraining for Language Understanding
- A Neural Conversational Model
- Deep Reinforcement Learning for Dialogue Generation
- Hollywood in Homes: Crowdsourcing Data Collection for Activity Understanding
- A Large-Scale Corpus for Conversation Disentanglement
- Just Sort It! A Simple and Effective Approach to Active Preference Learning
Cited by in corpus (22)
- SOLOIST: Building Task Bots at Scale with Transfer Learning and Machine Teaching
- Meta-evaluation of Conversational Search Evaluation Metrics
- Task-Oriented Dialogue System as Natural Language Generation
- STAR: A Schema-Guided Dialog Dataset for Transfer Learning
- DialBERT: A Hierarchical Pre-Trained Model for Conversation Disentanglement
- Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots
- DSTC8-AVSD: Multimodal Semantic Transformer Network with Retrieval Style Word Generator
- Pre-Trained and Attention-Based Neural Networks for Building Noetic Task-Oriented Dialogue Systems
- Find or Classify? Dual Strategy for Slot-Value Predictions on Multi-Domain Dialog State Tracking
- The SPPD System for Schema Guided Dialogue State Tracking Challenge
- RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems
- Learning Reasoning Paths over Semantic Graphs for Video-grounded Dialogues
- Is Your Goal-Oriented Dialog Model Performing Really Well? Empirical Analysis of System-wise Evaluation
- Zero-shot Generalization in Dialog State Tracking through Generative Question Answering
- Joint System-Wise Optimization for Pipeline Goal-Oriented Dialog System
- NeurIPS 2021 Competition IGLU: Interactive Grounded Language Understanding in a Collaborative Environment
- On the Calibration and Uncertainty of Neural Learning to Rank Models
- Is this Dialogue Coherent? Learning from Dialogue Acts and Entities
- Response Selection for Multi-Party Conversations with Dynamic Topic Tracking
- Leveraging Linguistic Coordination in Reranking N-Best Candidates For End-to-End Response Selection Using BERT
- POSSCORE: A Simple Yet Effective Evaluation of Conversational Search with Part of Speech Labelling
- Does Dialog Length matter for Next Response Selection task? An Empirical Study