Failure-Transparent Agents: Benchmarking Post-Failure Reporting in Tool-Using Language Models

Junru Zhu, Shiming Xie, Aime Lu Fan Chen +4

Tool-using agents can fail twice: a required tool can fail, and the agent can then report success without the evidence needed to justify it. Existing benchmarks often entangle this…