5 citations · 17 across the 27 of their papers we have counts for
Showing cs.HCShow all
2 papers · 1 filter
cs.HC2026
RealUserSim: Bridging the Reality Gap in Agent Benchmarking via Grounded User Simulation
Ming Zhu, Juntao Tan, Rithesh Murthy +6
LLM-based user simulation is the primary mechanism for end-to-end agent evaluation, yet simulated users are poor proxies for real humans: unconstrained LLM defaults produce a Forma…
cs.HC2024
Challenges in Trustworthy Human Evaluation of Chatbots
Wenting Zhao, Alexander M. Rush, Tanya Goyal
Open community-driven platforms like Chatbot Arena that collect user preference data from site visitors have gained a reputation as one of the most trustworthy publicly available b…