Offline Reinforcement Learning: Fundamental Barriers for Value Function Approximation

Dylan J. Foster, Akshay Krishnamurthy, David Simchi-Levi +1

We consider the offline reinforcement learning problem, where the aim is to learn a decision making policy from logged data. Offline RL -- particularly when coupled with (value) fu…