Conditions on Features for Temporal Difference-Like Methods to Converge

Marcus Hutter, Samuel Yang-Zhao, Sultan J. Majeed

The convergence of many reinforcement learning (RL) algorithms with linear function approximation has been investigated extensively but most proofs assume that these methods conver…