MirrorCraft: Paired Evaluation under Hidden Rule Changes in Minecraft

Jianxin Gao, Beini Hu, Runze Li +6

With the prosperity of the large language models (LLMs), it has become an interesting topic: how do LLM-based agents work in Minecraft? Unfortunately, most existing benchmarks eval…