From the 1 of 2 linked papers with an AI index.
2 papers
cs.AI2026
Automated Transcript Analysis for Detecting Flaws in Agentic Benchmarks
Jeff Mohl, Nelson Gardner-Challis, Magda Dubois +6
The paper presents automated AI scanners that analyze benchmark transcripts to detect validity flaws such as ground‑truth leakage, tool failures, guessing vulnerabilities, and ambi…
cs.AI2026
When can we trust untrusted monitoring? A safety case sketch across collusion strategies
Nelson Gardner-Challis, Jonathan Bostock, Georgiy Kozhevnikov +4
AIs are increasingly being deployed with greater autonomy and capabilities, which increases the risk that a misaligned AI may be able to cause catastrophic harm. Untrusted monitori…