Efficiently Solving Discounted MDPs with Predictions on Transition Matrices

Lixing Lyu, Jiashuo Jiang, Wang Chi Cheung

We study infinite-horizon Discounted Markov Decision Processes (DMDPs) under a generative model. Motivated by the Algorithm with Advice framework Mitzenmacher and Vassilvitskii 202…