Bridging the Gap Between Average and Discounted TD Learning

Haoxing Tian, Zaiwei Chen, Ioannis Ch. Paschalidis +1

The analysis of Temporal Difference (TD) learning in the average-reward setting faces notable theoretical difficulties because the Bellman operator is not contractive with respect…