activity
20162025
most citedBlack-Box Access is Insufficient for Rigorous AI Audits

72 citations · 80 across the 6 of their papers we have counts for

collaborators

6 papers

cs.SE2025★ 6 cited

The AI Agent Index

Stephen Casper, Luke Bailey, Rosco Hunter +12

Leading AI developers and startups are increasingly deploying agentic AI systems that can plan and execute complex tasks with limited human involvement. However, there is currently…

cs.CL2024★ 1 cited

An Assessment of Model-On-Model Deception

Julius Heitkoetter, Michael Gerovitch, Laker Newhouse

The trustworthiness of highly capable language models is put at risk when they are able to produce deceptive outputs. Moreover, when models are vulnerable to deception it undermine…

cs.CY2024★ 72 cited

Black-Box Access is Insufficient for Rigorous AI Audits

Stephen Casper, Carson Ezell, Charlotte Siegmann +18

External audits of AI systems are increasingly recognized as a key mechanism for AI governance. The effectiveness of an audit, however, depends on the degree of access granted to a…

math.CO2017★ 1 cited

On Variations of Nim and Chomp

June Ahn, Benjamin Chen, Richard Chen +8

We study two variations of Nim and Chomp which we call Monotonic Nim and Diet Chomp. In Monotonic Nim the moves are the same as in Nim, but the positions are non-decreasing numbers…

math.CO2016

Alternator Coins

Benjamin Chen, Ezra Erives, Leon Fan +9

We introduce a new type of coin: \textit{the alternator}. The alternator can pretend to be either a real or a fake coin (which is lighter than a real one). Each time it is put on a…

math.HO2016

Who Is Guilty?

Benjamin Chen, Ezra Erives, Leon Fan +9

We discuss a generalization of logic puzzles in which truth-tellers and liars are allowed to deviate from their pattern in case of one particular question: "Are you guilty?"