Off-policy estimation with adaptively collected data: the power of online learning

Jeonghwan Lee, Cong Ma

We consider estimation of a linear functional of the treatment effect using adaptively collected data. This task finds a variety of applications including the off-policy evaluation…