APRIL: Annotations for Policy evaluation with Reliable Inference from LLMs

Aishwarya Mandyam, Kalyani Limaye, Barbara E. Engelhardt +1

Off-policy evaluation (OPE) estimates the value of a contextual bandit policy prior to deployment. As such, OPE plays a critical role in ensuring safety in high-stakes domains such…