Stochastic first-order methods for average-reward Markov decision processes

Tianjiao Li, Feiyang Wu, Guanghui Lan

We study average-reward Markov decision processes (AMDPs) and develop novel first-order methods with strong theoretical guarantees for both policy optimization and policy evaluatio…