Efficient On-Policy Reinforcement Learning via Exploration of Sparse Parameter Space

Xinyu Zhang, Aishik Deb, Klaus Mueller

Policy-gradient methods such as Proximal Policy Optimization (PPO) are typically updated along a single stochastic gradient direction, leaving the rich local structure of the param…