Parameter-Free Federated TD Learning with Markov Noise in Heterogeneous Environments

Ankur Naskar, Gugan Thoppe, Utsav Negi +1

Federated learning (FL) can dramatically speed up reinforcement learning by distributing exploration and training across multiple agents. It can guarantee an optimal convergence ra…