On the Convergence of the Monte Carlo Exploring Starts Algorithm for Reinforcement Learning

Che Wang, Shuhan Yuan, Kai Shao +1

A simple and natural algorithm for reinforcement learning (RL) is Monte Carlo Exploring Starts (MCES), where the Q-function is estimated by averaging the Monte Carlo returns, and t…