45 citations · 182 across the 44 of their papers we have counts for
4 papers · 2 filters
A Note on Optimization Formulations of Markov Decision Processes
Lexing Ying, Yuhua Zhu
This note summarizes the optimization formulations used in the study of Markov decision processes. We consider both the discounted and undiscounted processes under the standard and…
Borrowing From the Future: Addressing Double Sampling in Model-free Control
Yuhua Zhu, Zach Izzo, Lexing Ying
In model-free reinforcement learning, the temporal difference method and its variants become unstable when combined with nonlinear function approximations. Bellman residual minimiz…
Mirror Descent Algorithms for Minimizing Interacting Free Energy
Lexing Ying
This note considers the problem of minimizing interacting free energy. Motivated by the mirror descent algorithm, for a given interacting free energy, we propose a descent dynamics…
Maximizing robustness of point-set registration by leveraging non-convexity
Cindy Orozco Bohorquez, Yuehaw Khoo, Lexing Ying
Point-set registration is a classical image processing problem that looks for the optimal transformation between two sets of points. In this work, we analyze the impact of outliers…