Hacking CTFs with Plain Agents

Rustem Turtayev, Artem Petrov, Dmitrii Volkov +1

We saturate a high-school-level hacking benchmark with plain LLM agent design. Concretely, we obtain 95% performance on InterCode-CTF, a popular offensive security benchmark, using…