Empirical entropy, minimax regret and minimax risk

Alexander Rakhlin, Karthik Sridharan, Alexandre B. Tsybakov

We consider the random design regression model with square loss. We propose a method that aggregates empirical minimizers (ERM) over appropriately chosen random subsets and reduces…