Showing 2025Show all
2 papers · 1 filter
math.PR2025
On the instability of local learning algorithms: Q-learning can fail in infinite state spaces
Urtzi Ayesta, Sergey Foss, Matthieu Jonckheere +1
We investigate the challenges of applying model-free reinforcement learning algorithms, like online Q-learning, to infinite state space Markov Decision Processes (MDPs). We first i…
cs.IT2025
On the Age of Information in Single-Server Queues with Aged Updates
Fernando Miguelez, Urtzi Ayesta, Josu Doncel +1
The Age of Information (AoI) is a performance metric that quantifies the freshness of data in systems where timely updates are critical. Most state-of-the-art methods typically ass…