Instance-Dependent Regret for CMDPs with Step-Wise Constraints

Qian Zuo, Francesco Emanuele Stradi, Leyang Xue +1

We study online learning in episodic tabular constrained Markov decision processes with step-wise safety constraints. In such a setting, the constraints induce a safe subgraph that…