On the Curses of Future and History in Future-dependent Value Functions for Off-policy Evaluation

Yuheng Zhang, Nan Jiang

We study off-policy evaluation (OPE) in partially observable environments with complex observations, with the goal of developing estimators whose guarantee avoids exponential depen…