57 citations · 58 across the 3 of their papers we have counts for
3 papers
cs.LG2025
The Actor-Critic Update Order Matters for PPO in Federated Reinforcement Learning
Zhijie Xie, Shenghui Song
In the context of Federated Reinforcement Learning (FRL), applying Proximal Policy Optimization (PPO) faces challenges related to the update order of its actor and critic due to th…
cs.LG2023★ 1 cited
Client Selection for Federated Policy Optimization with Environment Heterogeneity
Zhijie Xie, Shenghui Song
The development of Policy Iteration (PI) has inspired many recent algorithms for Reinforcement Learning (RL), including several policy gradient methods that gained both theoretical…
cs.LG2022★ 57 cited
FedKL: Tackling Data Heterogeneity in Federated Reinforcement Learning by Penalizing KL Divergence
Zhijie Xie, S. H. Song
As a distributed learning paradigm, Federated Learning (FL) faces the communication bottleneck issue due to many rounds of model synchronization and aggregation. Heterogeneous data…