CraftBench-UE: Deterministic Evaluation for Coding Agents in Unreal Engine

Shutong Wu, Kevin Calderone, Andy Tsen

Building gameplay features in a game engine requires more than code, as code that compiles and runs does not necessarily implement the requested gameplay. We introduce CraftBenchUE…