Poisson Tangent Limits and Critical Policy Switching for Sampled Bellman Operators

Ming-Zhe Dai, Chengxi Zhang

Consider a discounted Markov decision process with continuous action space in which, at each state visit, the controller draws a random pool of $N$ candidate actions and selects am…