2 citations · 3 across the 3 of their papers we have counts for
4 papers · 1 filter
Instance-Dependent Confidence and Early Stopping for Reinforcement Learning
Koulik Khamaru, Eric Xia, Martin J. Wainwright +1
Various algorithms for reinforcement learning (RL) exhibit dramatic variation in their convergence rates as a function of problem structure. Such problem-dependent behavior is not…
Instance-optimality in optimal value estimation: Adaptivity via variance-reduced Q-learning
Koulik Khamaru, Eric Xia, Martin J. Wainwright +1
Various algorithms in reinforcement learning exhibit dramatic variability in their convergence rates and ultimate accuracy as a function of the problem structure. Such instance-spe…
Is Temporal Difference Learning Optimal? An Instance-Dependent Analysis
Koulik Khamaru, Ashwin Pananjady, Feng Ruan +2
We address the problem of policy evaluation in discounted Markov decision processes, and provide instance-dependent guarantees on the -error under a generative model.…
Convergence guarantees for a class of non-convex and non-smooth optimization problems
Koulik Khamaru, Martin J. Wainwright
We consider the problem of finding critical points of functions that are non-convex and non-smooth. Studying a fairly broad class of such problems, we analyze the behavior of three…