Words to World: Benchmarking LLMs in Interactive Physical Environments

Xinnan Dai, Kaiqi Yang, Yaxin Li +9

Words are increasingly becoming an interface for action: large language models (LLMs) can now invoke tools, operate devices, and make decisions that affect the physical world. Howe…