activity
20232026
most citedUser Simulation with Large Language Models for Evaluating Task-Oriented Dialogue

4 citations · 9 across the 14 of their papers we have counts for

collaborators

14 papers

cs.AI2026

Selective Regenerative Decoding: Trajectory-Level Intervention for Inference-Time Reasoning

Sophia Xiao Pu, Yumo Xu, Sailik Sengupta +5

Inference-time decoding methods improve LLM reasoning by exploring multiple candidate trajectories, yet treat each trajectory as atomic: either retaining it whole or discarding it…

cs.AI2026

MemToolAgent: Leveraging Memory for Tool Using Agents Based on Environment and User Feedback

Suleyman Armagan Er, Danilo Ribeiro, Yogesh Virkar +5

Modern large language model (LLM) agents can use external tools to help users solve complex tasks. However, for problems that require learning from long-term historical events or f…

cs.CL2026

ConvApparel: A Benchmark Dataset and Validation Framework for User Simulators in Conversational Recommenders

Ofer Meshi, Krisztian Balog, Sally Goldman +5

The promise of LLM-based user simulators to improve conversational AI is hindered by a critical "realism gap," leading to systems that are optimized for simulated interactions, but…

cs.CL2025

Controllable Conversational Theme Detection Track at DSTC 12

Igor Shalyminov, Hang Su, Jake Vincent +5

Conversational analytics has been on the forefront of transformation driven by the advances in Speech and Natural Language Processing techniques. Rapid adoption of Large Language M…

cs.CL2025

CONFETTI: Conversational Function-Calling Evaluation Through Turn-Level Interactions

Tamer Alkhouli, Katerina Margatina, James Gung +4

We introduce Conversational Function-Calling Evaluation Through Turn-Level Interactions (CONFETTI), a conversational benchmark1 designed to evaluate the function-calling capabiliti…

cs.AI2025

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development

Ming Shen, Raphael Shu, Anurag Pratik +4

We have seen remarkable progress in large language models (LLMs) empowered multi-agent systems solving complex tasks necessitating cooperation among experts with diverse skills. Ho…

cs.CL2024★ 1 cited

Structured List-Grounded Question Answering

Mujeen Sung, Song Feng, James Gung +3

Document-grounded dialogue systems aim to answer user queries by leveraging external information. Previous studies have mainly focused on handling free-form documents, often overlo…

cs.CL2024

DFlow: Diverse Dialogue Flow Simulation with Large Language Models

Wanyu Du, Song Feng, James Gung +4

Developing language model-based dialogue agents requires effective data to train models that can follow specific task logic. However, most existing data simulation methods focus on…

cs.CL2023★ 4 cited

User Simulation with Large Language Models for Evaluating Task-Oriented Dialogue

Sam Davidson, Salvatore Romeo, Raphael Shu +4

One of the major impediments to the development of new task-oriented dialogue (TOD) systems is the need for human evaluation at multiple stages and iterations of the development pr…

cs.CL2023★ 1 cited

DiactTOD: Learning Generalizable Latent Dialogue Acts for Controllable Task-Oriented Dialogue Systems

Qingyang Wu, James Gung, Raphael Shu +1

Dialogue act annotations are important to improve response generation quality in task-oriented dialogue systems. However, it can be challenging to use dialogue acts to control resp…

cs.AI2023

Measuring and Mitigating Constraint Violations of In-Context Learning for Utterance-to-API Semantic Parsing

Shufan Wang, Sebastien Jean, Sailik Sengupta +3

In executable task-oriented semantic parsing, the system aims to translate users' utterances in natural language to machine-interpretable programs (API calls) that can be executed…

cs.CL2023

NatCS: Eliciting Natural Customer Support Dialogues

James Gung, Emily Moeng, Wesley Rose +3

Despite growing interest in applications based on natural customer support conversations, there exist remarkably few publicly available datasets that reflect the expected character…

cs.CL2023

Pre-training Intent-Aware Encoders for Zero- and Few-Shot Intent Classification

Mujeen Sung, James Gung, Elman Mansimov +5

Intent classification (IC) plays an important role in task-oriented dialogue systems. However, IC models often generalize poorly when training without sufficient annotated examples…

cs.CL2023★ 3 cited

Intent Induction from Conversations for Task-Oriented Dialogue Track at DSTC 11

James Gung, Raphael Shu, Emily Moeng +6

With increasing demand for and adoption of virtual assistants, recent work has investigated ways to accelerate bot schema design through the automatic induction of intents or the i…