activity
20212023
most citedSimulating User Satisfaction for the Evaluation of Task-oriented Dialogue Systems

38 citations · 85 across the 7 of their papers we have counts for

collaborators

7 papers

cs.CL2023

RADE: Reference-Assisted Dialogue Evaluation for Open-Domain Dialogue

Zhengliang Shi, Weiwei Sun, Shuo Zhang +3

Evaluating open-domain dialogue systems is challenging for reasons such as the one-to-many problem, i.e., many appropriate responses other than just the golden response. As of now,…

cs.CL2023★ 1 cited

InfoSync: Information Synchronization across Multilingual Semi-structured Tables

Siddharth Khincha, Chelsi Jain, Vivek Gupta +2

Information Synchronization of semi-structured data across languages is challenging. For instance, Wikipedia tables in one language should be synchronized across languages. To addr…

cs.IR2023★ 35 cited

Towards Explainable Conversational Recommender Systems

Shuyu Guo, Shuo Zhang, Weiwei Sun +3

Explanations in conventional recommender systems have demonstrated benefits in helping the user understand the rationality of the recommendations and improving the system's efficie…

cs.CL2022

Realistic Data Augmentation Framework for Enhancing Tabular Reasoning

Dibyakanti Kumar, Vivek Gupta, Soumya Sharma +1

Existing approaches to constructing training data for Natural Language Inference (NLI) tasks, such as for semi-structured table reasoning, are either via crowdsourcing or fully aut…

cs.CL2022★ 2 cited

Enhancing Tabular Reasoning with Pattern Exploiting Training

Abhilash Reddy Shankarampeta, Vivek Gupta, Shuo Zhang

Recent methods based on pre-trained language models have exhibited superior performance over tabular tasks (e.g., tabular NLI), despite showing inherent problems such as not using…

cs.CL2021★ 9 cited

TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Finance

Fengbin Zhu, Wenqiang Lei, Youcheng Huang +5

Hybrid data combining both tabular and textual content (e.g., financial reports) are quite pervasive in the real world. However, Question Answering (QA) over such hybrid data is la…

cs.IR2021★ 38 cited

Simulating User Satisfaction for the Evaluation of Task-oriented Dialogue Systems

Weiwei Sun, Shuo Zhang, Krisztian Balog +4

Evaluation is crucial in the development process of task-oriented dialogue systems. As an evaluation method, user simulation allows us to tackle issues such as scalability and cost…