Primal-Dual Sample Complexity Bounds for Constrained Markov Decision Processes with Multiple Constraints

Max Buckley, Konstantinos Papathanasiou, Andreas Spanopoulos

This paper addresses the challenge of solving Constrained Markov Decision Processes (CMDPs) with $d>1$ constraints when the transition dynamics are unknown, but samples can be dr…