Learning Suffers More Than the Policy Class Under Partial Observability: A Closed-Form Analysis

Idil Gözel

When a reinforcement learning agent cannot observe the full state, we usually blame its policies: it cannot see enough to represent a good one. We show that in a solvable case the…