On the Convergence Rates of Federated Q-Learning across Heterogeneous Environments

Leo Muxing Wang, Pengkun Yang, Lili Su

Large-scale multi-agent systems are often deployed across wide geographic areas, where agents interact with heterogeneous environments. There is an emerging interest in understandi…