Sampling Complexity of TD and PPO in RKHS

Lu Zou, Wendi Ren, Weizhong Zhang +2

We revisit Proximal Policy Optimization (PPO) from a function-space perspective. Our analysis decouples policy evaluation and improvement in a reproducing kernel Hilbert space (RKH…