Reusing Past Samples in Proximal Policy Optimization: When and How Does It Help?

Alessandro Montenegro, Riccardo Venturelli, Marco Mussi +2

Among on-policy deep reinforcement learning methods, Proximal Policy Optimization (PPO) has become the de facto standard, due to its consistently strong empirical performance acros…