Visualizing the World Model in an Agent's Value Function

Shawheen Naderi, Fatemeh Akherati, Yubei Chen

Could model-free reinforcement learning algorithms actually be learning a model of the environment? In this work, we apply counterfactual interventions which hold everything about…