Planning by Prioritized Sweeping with Small Backups

Harm van Seijen, Richard S. Sutton

Efficient planning plays a crucial role in model-based reinforcement learning. Traditionally, the main planning operation is a full backup based on the current estimates of the suc…