works on
ai safety 1automated auditing 1benchmark evaluation 1model validation 1transcript analysis 1

From the 1 of 1 linked paper with an AI index.

collaborators

1 paper

cs.AI2026

Automated Transcript Analysis for Detecting Flaws in Agentic Benchmarks

Jeff Mohl, Nelson Gardner-Challis, Magda Dubois +6

The paper presents automated AI scanners that analyze benchmark transcripts to detect validity flaws such as ground‑truth leakage, tool failures, guessing vulnerabilities, and ambi…