Do Differentiable Simulators Give Better Policy Gradients?

H. J. Terry Suh, Max Simchowitz, Kaiqing Zhang +1

Differentiable simulators promise faster computation time for reinforcement learning by replacing zeroth-order gradient estimates of a stochastic objective with an estimate based o…