Unbiased estimators for random design regression

Michał Dereziński, Manfred K. Warmuth, Daniel Hsu

In linear regression we wish to estimate the optimum linear least squares predictor for a distribution over $d$-dimensional input points and real-valued responses, based on a small…