297 citations · 537 across the 4 of their papers we have counts for
3 papers · 1 filter
MADS: Multi-Agent Dialog Simulation for Robust Conversational Agents
Arkajyoti Chakraborty, Adam Zernik, Ishika Kulkarni +6
Task-oriented conversational agents remain fragile under realistic conditions, especially when users exhibit non-cooperative behavior. Existing function-calling benchmarks underrep…
ToolRACER: A Robust Agentic Conversation Emulation Resource for Agent Training and Evaluation
Arkajyoti Chakraborty, Aryan Tayal, Ishika Agarwal +5
Task-oriented conversational agents remain fragile under real world conversation scenarios as they rarely follow a predictable script, especially when users exhibit non-cooperative…
Game Arena: Strategic LLM Evaluation in Competitive Environments
Bovard Doerschuk-Tiberi, Yao Yan, Justin Chiu +59
We introduce Kaggle Game Arena, an open and ever-expanding platform to evaluate large language models (LLMs) through competitive games. Different from static benchmarks, game arena…