Geometry and Determinism of Optimal Stationary Control in Partially Observable Markov Decision Processes

Guido Montufar, Keyan Ghazi-Zahedi, Nihat Ay

It is well known that for any finite state Markov decision process (MDP) there is a memoryless deterministic policy that maximizes the expected reward. For partially observable Mar…