An Empirical Analysis of Proximal Policy Optimization with Kronecker-factored Natural Gradients

Jiaming Song, Yuhuai Wu

In this technical report, we consider an approach that combines the PPO objective and K-FAC natural gradient optimization, for which we call PPOKFAC. We perform a range of empirica…