11 citations · 14 across the 7 of their papers we have counts for
4 papers · 1 filter
A Note on Optimization Formulations of Markov Decision Processes
Lexing Ying, Yuhua Zhu
This note summarizes the optimization formulations used in the study of Markov decision processes. We consider both the discounted and undiscounted processes under the standard and…
Why resampling outperforms reweighting for correcting sampling bias with stochastic gradients
Jing An, Lexing Ying, Yuhua Zhu
A data set sampled from a certain population is biased if the subgroups of the population are sampled at proportions that are significantly different from their underlying proporti…
Borrowing From the Future: Addressing Double Sampling in Model-free Control
Yuhua Zhu, Zach Izzo, Lexing Ying
In model-free reinforcement learning, the temporal difference method and its variants become unstable when combined with nonlinear function approximations. Bellman residual minimiz…
A Sharp Convergence Rate for the Asynchronous Stochastic Gradient Descent
Yuhua Zhu, Lexing Ying
We give a sharp convergence rate for the asynchronous stochastic gradient descent (ASGD) algorithms when the loss function is a perturbed quadratic function based on the stochastic…