activity
20192026
most citedOn the Convergence of FedAvg on Non-IID Data

979 citations · 1k across the 15 of their papers we have counts for

collaborators
Showing 2023Show all

5 papers · 1 filter

stat.ML2023

Estimation and Inference in Distributional Reinforcement Learning

Liangyu Zhang, Yang Peng, Jiadong Liang +2

In this paper, we study distributional reinforcement learning from the perspective of statistical efficiency. We investigate distributional policy evaluation, aiming to estimate th…

cs.LG2023

Regularization and Variance-Weighted Regression Achieves Minimax Optimality in Linear MDPs: Theory and Practice

Toshinori Kitamura, Tadashi Kozuno, Yunhao Tang +12

Mirror descent value iteration (MDVI), an abstraction of Kullback-Leibler (KL) and entropy-regularized reinforcement learning (RL), has served as the basis for recent high-performi…

cs.LG2023★ 2 cited

Non-stationary Projection-free Online Learning with Dynamic and Adaptive Regret Guarantees

Yibo Wang, Wenhao Yang, Wei Jiang +5

Projection-free online learning has drawn increasing interest due to its efficiency in solving high-dimensional problems with complicated constraints. However, most existing projec…

cs.LG2023

Semi-Infinitely Constrained Markov Decision Processes and Efficient Reinforcement Learning

Liangyu Zhang, Yang Peng, Wenhao Yang +1

We propose a novel generalization of constrained Markov decision processes (CMDPs) that we call the \emph{semi-infinitely constrained Markov decision process} (SICMDP). Particularl…

stat.ML2023★ 1 cited

Robust Markov Decision Processes without Model Estimation

Wenhao Yang, Han Wang, Tadashi Kozuno +2

Robust Markov Decision Processes (MDPs) are receiving much attention in learning a robust policy which is less sensitive to environment changes. There are an increasing number of w…