An Alternate Policy Gradient Estimator for Softmax Policies

Shivam Garg, Samuele Tosatto, Yangchen Pan +2

Policy gradient (PG) estimators are ineffective in dealing with softmax policies that are sub-optimally saturated, which refers to the situation when the policy concentrates its pr…