On the instability of local learning algorithms: Q-learning can fail in infinite state spaces

Urtzi Ayesta, Sergey Foss, Matthieu Jonckheere +1

We investigate the challenges of applying model-free reinforcement learning algorithms, like online Q-learning, to infinite state space Markov Decision Processes (MDPs). We first i…