SpeedrunBench: Challenging LLM Agents with Video Game Speedrunning

Yoshinari Fujinuma, Keisuke Kamahori, Ryuto Koike +8

Frontier LLM agents have been shown to be capable of solving increasingly complex tasks for which humans have measurable solutions. This begs the pertinent question of whether LLM…