Why Do LLM Agents Fail in Exploring New Environments? A World-Modeling Perspective

Shiqi Chen, Tongyao Zhu, Zian Wang +8

Large Language Models (LLMs) as agents often fail to improve in new environments. We identify and characterize a failure mode we call exploration collapse: under reinforcement lear…