3 citations · 5 across the 10 of their papers we have counts for
Showing 2026Show all
3 papers · 1 filter
cs.AI2026
Do Agent Benchmarks Measure Capability? Protocol Validity in the Age of Agentic AI
Jiaqi Shao, Hanck Chen, Wei Zhang +2
Agent benchmarks increasingly evaluate repository editing, web research, terminal use, and long-horizon interaction. Their scores support capability claims only when the evaluation…
cs.AI2026
Do More Agents Help? Evaluating Accuracy and Cost in LLM Multi-Agent Workflows
Yuhang Fu, Ruishan Fang, Jiaqi Shao +5
Choosing whether to replace a single-agent controller requires evidence on both task performance and inference expenditure. We present BenchAgent, a shared evaluation framework, an…
cs.AI2026
When Stored Evidence Stops Being Usable: Scale-Conditioned Evaluation of Agent Memory
Jiaqi Shao, Yiyi Lu, Yunzhen Zhang +1
Memory-agent evaluations report fixed-snapshot accuracy or retrieval quality, but these scores do not show whether evidence remains usable as irrelevant sessions (sessions not anno…