Advanced Policies: A First-Principles Path from Policy Gradient to Q-Learning

Donghoon Lee

We apply entropy to reinforcement learning in two ways: entropy-augmented reward defines the soft objective, while relative-entropy regularization controls the size of a policy-imp…