Little Exploration is All You Need

Henry H. H. Chen, Jiaming Lu

The prevailing principle of "Optimism in the Face of Uncertainty" advocates for the incorporation of an exploration bonus, generally assumed to be proportional to the inverse squar…