MirrorCraft: Paired Evaluation under Hidden Rule Changes in Minecraft

Jianxin Gao, Beini Hu, Runze Li +7

With the rapid progress of large language models (LLMs), an interesting question has emerged: how do LLM-based agents perform in Minecraft? To date, most Minecraft benchmarks evalu…