Analysis of Q-learning with Adaptation and Momentum Restart for Gradient Descent

Bowen Weng, Huaqing Xiong, Yingbin Liang +1

Existing convergence analyses of Q-learning mostly focus on the vanilla stochastic gradient descent (SGD) type of updates. Despite the Adaptive Moment Estimation (Adam) has been co…