37 citations · 63 across the 9 of their papers we have counts for
13 papers
What is wrong with you?: Leveraging User Sentiment for Automatic Dialog Evaluation
Sarik Ghazarian, Behnam Hedayatnia, Alexandros Papangelis +2
Accurate automatic evaluation metrics for open-domain dialogs are in high demand. Existing model-based metrics for system response evaluation are trained on human annotated data, w…
Towards Textual Out-of-Domain Detection without In-Domain Labels
Di Jin, Shuyang Gao, Seokhwan Kim +2
In many real-world settings, machine learning models need to identify user inputs that are out-of-domain (OOD) so as to avoid performing wrong actions. This work focuses on a chall…
DirectQuote: A Dataset for Direct Quotation Extraction and Attribution in News Articles
Yuanchi Zhang, Yang Liu
Quotation extraction and attribution are challenging tasks, aiming at determining the spans containing quotations and attributing each quotation to the original speaker. Applying t…
"How Robust r u?": Evaluating Task-Oriented Dialogue Systems on Spoken Conversations
Seokhwan Kim, Yang Liu, Di Jin +4
Most prior work in dialogue modeling has been on written conversations mostly because of existing data sets. However, written dialogues are not sufficient to fully capture the natu…
Commonsense-Focused Dialogues for Response Generation: An Empirical Study
Pei Zhou, Karthik Gopalakrishnan, Behnam Hedayatnia +5
Smooth and effective communication requires the ability to perform latent or explicit commonsense inference. Prior commonsense reasoning benchmarks (such as SocialIQA and Commonsen…
Towards Zero and Few-shot Knowledge-seeking Turn Detection in Task-orientated Dialogue Systems
Di Jin, Shuyang Gao, Seokhwan Kim +2
Most prior work on task-oriented dialogue systems is restricted to supporting domain APIs. However, users may have requests that are out of the scope of these APIs. This work focus…