Model-Free and Model-Based Policy Evaluation when Causality is Uncertain

David Bruns-Smith

When decision-makers can directly intervene, policy evaluation algorithms give valid causal estimates. In off-policy evaluation (OPE), there may exist unobserved variables that bot…