Matryoshka Policy Gradient for Entropy-Regularized RL: Convergence and Global Optimality

François Ged, Maria Han Veiga

A novel Policy Gradient (PG) algorithm, called $\text{Matryoshka Policy Gradient}$ (MPG), is introduced and studied, in the context of fixed-horizon max-entropy reinforcement lea…