All-Action Policy Gradient Methods: A Numerical Integration Approach

Benjamin Petit, Loren Amdahl-Culleton, Yao Liu +2

While often stated as an instance of the likelihood ratio trick [Rubinstein, 1989], the original policy gradient theorem [Sutton, 1999] involves an integral over the action space.…