Showing cs.AIShow all
2 papers · 1 filter
cs.AI2026
PieArena: Ranking and Profiling Language Agents in Realistic Negotiation Scenarios
Chris Zhu, Sasha Cui, Will Sanok Dufallo +4
We present an in-depth evaluation of LLMs' ability to negotiate, a central business task requiring strategic reasoning, theory of mind, and economic value creation. To do so, we in…
cs.AI2025
Establishing Best Practices for Building Rigorous Agentic Benchmarks
Yuxuan Zhu, Tengjun Jin, Yada Pruksachatkun +22
Benchmarks are essential for quantitatively tracking progress in AI. As AI agents become increasingly capable, researchers and practitioners have introduced agentic benchmarks to e…