Instance-optimality in optimal value estimation: Adaptivity via variance-reduced Q-learning

Koulik Khamaru, Eric Xia, Martin J. Wainwright +1

Various algorithms in reinforcement learning exhibit dramatic variability in their convergence rates and ultimate accuracy as a function of the problem structure. Such instance-spe…