Frozen Policy Iteration: Computationally Efficient RL under Linear $Q^{\pi }$ Realizability for Deterministic Dynamics

Yijing Ke, Zihan Zhang, Ruosong Wang

We study computationally and statistically efficient reinforcement learning under the linear $Q^{\pi }$ realizability assumption, where any policy's $Q$-function is linear in a given st…