Residual Overfit Method of Exploration

James McInerney, Nathan Kallus

Exploration is a crucial aspect of bandit and reinforcement learning algorithms. The uncertainty quantification necessary for exploration often comes from either closed-form expres…