Show, Don't Tell: Demonstrations Outperform Descriptions for Schema-Guided Task-Oriented Dialogue

Abstract

Building universal dialogue systems that operate across multiple domains/APIs and generalize to new ones with minimal overhead is a critical challenge. Recent works have leveraged natural language descriptions of schema elements to enable such systems; however, descriptions only indirectly convey schema semantics. In this work, we propose Show, Don't Tell, which prompts seq2seq models with a labeled example dialogue to show the semantics of schema elements rather than tell the model through descriptions. While requiring similar effort from service developers as generating descriptions, we show that using short examples as schema representations with large language models results in state-of-the-art performance on two popular dialogue state tracking benchmarks designed to measure zero-shot generalization - the Schema-Guided Dialogue dataset and the MultiWOZ leave-one-out benchmark.

NAACL 2022

References in corpus (7)

• Language Models as Few-Shot Learner for Task-Oriented Dialogue Systems
• Description-Driven Task-Oriented Dialog Modeling
• Schema-Guided Dialogue State Tracking Task at DSTC8
• An End-to-End Dialogue State Tracking System with Machine Reading Comprehension and Wide & Deep Classification
• SGD-X: A Benchmark for Robust Generalization in Schema-Guided Dialogue Systems
• Fine-Tuning BERT for Schema-Guided Zero-Shot Dialogue State Tracking
• SGD-QA: Fast Schema-Guided Dialogue State Tracking for Unseen Services