Pretraining & Reinforcement Learning: Sharpening the Axe Before Cutting the Tree

Saurav Kadavath, Samuel Paradis, Brian Yao

Pretraining is a common technique in deep learning for increasing performance and reducing training time, with promising experimental results in deep reinforcement learning (RL). H…