3 papers
cs.LG2026
Quotient-Categorical Representations for Bellman-Compatible Average-Reward Distributional Reinforcement Learning
Ege C. Kaya, Aliasghar Pourghani, Vijay Gupta +1
Average-reward reinforcement learning requires estimating the gain and the bias, which is defined only up to an additive constant. This makes direct distributional analogues ill-po…
cs.LG2026
Parameter-free Optimal Rates for Nonlinear Semi-Norm Contractions with Applications to -Learning
Ankur Naskar, Gugan Thoppe, Vijay Gupta
Algorithms for solving \textit{nonlinear} fixed-point equations -- such as average-reward \textit{-learning} and \textit{TD-learning} -- often involve semi-norm contractions. Ac…
cs.LG2025
Parameter-Free Federated TD Learning with Markov Noise in Heterogeneous Environments
Ankur Naskar, Gugan Thoppe, Utsav Negi +1
Federated learning (FL) can dramatically speed up reinforcement learning by distributing exploration and training across multiple agents. It can guarantee an optimal convergence ra…