On Convergence of Gradient Expected Sarsa($\lambda$)

Long Yang, Gang Zheng, Yu Zhang +3

We study the convergence of $\mathtt{Expected}\mathtt{Sarsa}(\lambda )$ with linear function approximation. We show that applying the off-line estimate (multi-step bootstrapping) to $\mathtt{Expe…