Reward Observability and the Limits of Offline Checkpoint Selection in RSSM World Models

Nikolai Smolyanskiy, Jonathan Shock

We study the closed-loop properties of a recurrent state-space model (RSSM) world model trained on human demonstrations in Gymnasium's LunarLander-v3. We use the trained world mode…