activity
20172023
most citedQ-learning with UCB Exploration is Sample Efficient for Infinite-Horizon MDP

32 citations · 60 across the 17 of their papers we have counts for

collaborators

17 papers

cs.DS2023

Near-linear time samplers for matroid independent sets with applications

Xiaoyu Chen, Heng Guo, Xinyuan Zhang +1

We give a time almost uniform sampler for independent sets of a matroid, whose ground set has elements and is given by an independence oracle. As a consequen…

math.PR2022

A Near-Linear Time Sampler for the Ising Model with External Field

Xiaoyu Chen, Xinyuan Zhang

We give a near-linear time sampler for the Gibbs distribution of the ferromagnetic Ising models with edge activities and external fields (or sym…

math-ph2022

Optimal mixing for two-state anti-ferromagnetic spin systems

Xiaoyu Chen, Weiming Feng, Yitong Yin +1

We prove an optimal lower bound for modified log-Sobolev (MLS) constant of the Glauber dynamics for anti-ferromagnetic two-spin systems with vertices in the tree un…

math.PR2021★ 4 cited

Optimal Mixing Time for the Ising Model in the Uniqueness Regime

Xiaoyu Chen, Weiming Feng, Yitong Yin +1

We prove an optimal mixing time of the Glauber dynamics for the Ising models with edge activity . This mixing time bound h…

cs.LG2021★ 4 cited

Distributional Reinforcement Learning for Multi-Dimensional Reward Functions

Pushi Zhang, Xiaoyu Chen, Li Zhao +3

A growing trend for value-based reinforcement learning (RL) algorithms is to capture more information than scalar value functions in the value network. One of the most well-known m…

cs.LG2021★ 2 cited

Near-Optimal Reward-Free Exploration for Linear Mixture MDPs with Plug-in Solver

Xiaoyu Chen, Jiachen Hu, Lin F. Yang +1

Although model-based reinforcement learning (RL) approaches are considered more sample efficient, existing algorithms are usually relying on sophisticated planning algorithm to cou…