Training Dynamics and Induced Preconditioning of ReLU Policy Gradient for Scalar LQR

Jhojan A. Rodriguez-Gil, César A. Uribe

Policy gradient is not invariant to reparameterization; the training dynamics of the weights of a neural controller differ from those of the induced gains. We make that difference…