Non-asymptotic Convergence of Average-reward Q-learning with Options

Kintan Saha, Ahana Deb, Anders Jonsson +1

We study the finite-sample convergence of Q-learning algorithms for the average-reward formulation of Reinforcement Learning (RL) with options. While options allow temporarily exte…