6 citations · 6 across the 3 of their papers we have counts for
Showing 2025Show all
2 papers · 1 filter
cs.LG2025
A Minimal-Assumption Analysis of Q-Learning with Time-Varying Policies
Phalguni Nanda, Zaiwei Chen
In this work, we present the first finite-time analysis of Q-learning with time-varying learning policies (i.e., on-policy sampling) for discounted Markov decision processes under…
cs.LG2025
From Set Convergence to Pointwise Convergence: Finite-Time Guarantees for Average-Reward Q-Learning with Adaptive Stepsizes
Zaiwei Chen, Phalguni Nanda
This work presents the first finite-time analysis for the last-iterate convergence of average-reward -learning with an asynchronous implementation. A key feature of the algorith…