2 citations · 2 across the 8 of their papers we have counts for
6 papers · 1 filter
-Multilingual: Benchmarking Voice Agents Across Languages
Soham Ray, Edgard dos Santos Paiva, Ruben Valenzuela +3
English-only benchmarks expose only a narrow slice of voice-agent behavior. We introduce -Multilingual, extending -Voice to Spanish, Brazilian Portuguese, Hindi, Korean, and…
-Elicitation: Benchmarking multi-turn entity extraction in voice agents
Soham Ray, Victor Barres
Voice agents often need to collect names, addresses, identifiers, dates, and times exactly, yet end-to-end benchmarks obscure where capture fails. We introduce -Elicitation, a 2…
-Bench: An Environment for End-To-End, Realistic Agent Construction
Quan Shi, Keshav Dhandhania, Karthik Narasimhan +1
LLM agents are rapidly becoming production software, deployed to handle customer service, adjudicate disputes, and operate internal systems. Notably, the work of building them is i…
AgentBeats: Agentifying Agent Assessment for Openness, Standardization, and Reproducibility
Xiaoyuan Liu, Jianhong Tu, Yuqi Chen +26
Agent systems are advancing quickly across domains, but their evaluation remains fragmented. Most benchmarks rely on fixed, LLM-centric harnesses that require heavy integration, cr…
-Voice: Benchmarking Full-Duplex Voice Agents on Real-World Domains
Soham Ray, Keshav Dhandhania, Victor Barres +1
Full-duplex voice agents--systems that listen and speak simultaneously--are rapidly moving from research to production. However, existing evaluations address conversational dynamic…
-Knowledge: Evaluating Conversational Agents over Unstructured Knowledge
Quan Shi, Alexandra Zytek, Pedram Razavi +2
Conversational agents are increasingly deployed in knowledge-intensive settings, where correct behavior depends on retrieving and applying domain-specific knowledge from large, pro…