219 citations · 513 across the 53 of their papers we have counts for
8 papers · 1 filter
Let's Do a Thought Experiment: Using Counterfactuals to Improve Moral Reasoning
Xiao Ma, Swaroop Mishra, Ahmad Beirami +2
Language models still struggle on moral reasoning, despite their impressive performance in many other tasks. In particular, the Moral Scenarios task in MMLU (Multi-task Language Un…
Robust Conversational Agents against Imperceptible Toxicity Triggers
Ninareh Mehrabi, Ahmad Beirami, Fred Morstatter +1
Warning: this paper contains content that maybe offensive or upsetting. Recent research in Natural Language Processing (NLP) has advanced the development of various toxicity detect…
Database Search Results Disambiguation for Task-Oriented Dialog Systems
Kun Qian, Ahmad Beirami, Satwik Kottur +5
As task-oriented dialog systems are becoming increasingly popular in our lives, more realistic tasks have been proposed and explored. However, new practical challenges arise. For i…
Know Thy Strengths: Comprehensive Dialogue State Tracking Diagnostics
Hyundong Cho, Chinnadhurai Sankar, Christopher Lin +5
Recent works that revealed the vulnerability of dialogue state tracking (DST) models to distributional shifts have made holistic comparisons on robustness and qualitative analyses…
Annotation Inconsistency and Entity Bias in MultiWOZ
Kun Qian, Ahmad Beirami, Zhouhan Lin +4
MultiWOZ is one of the most popular multi-domain task-oriented dialog datasets, containing 10K+ annotated dialogs covering eight domains. It has been widely accepted as a benchmark…
Overview of the Ninth Dialog System Technology Challenge: DSTC9
Chulaka Gunasekara, Seokhwan Kim, Luis Fernando D'Haro +36
This paper introduces the Ninth Dialog System Technology Challenge (DSTC-9). This edition of the DSTC focuses on applying end-to-end dialog technologies for four distinct tasks in…