Showing math.PRShow all
2 papers · 1 filter
math.PR2025
On the instability of local learning algorithms: Q-learning can fail in infinite state spaces
Urtzi Ayesta, Sergey Foss, Matthieu Jonckheere +1
We investigate the challenges of applying model-free reinforcement learning algorithms, like online Q-learning, to infinite state space Markov Decision Processes (MDPs). We first i…
math.PR2024
Decision-Epoch Matters: Unveiling its Impact on the Stability of Scheduling with Randomly Varying Connectivity
Nahuel Soprano-Loto, Urtzi Ayesta, Matthieu Jonckheere +1
A classical queuing theory result states that in a parallel-queue single-server model, the maximum stability region does not depend on the scheduling decision epochs, and in partic…