Nonstandard Errors in AI Agents

Ruijiang Gao, Steven Chong Xiao

We study whether state-of-the-art AI coding agents, given the same data and research question, produce the same empirical results. Deploying 150 autonomous Claude Code agents to in…