Unbiased least squares regression via averaged stochastic gradient descent

Nabil Kahalé

We consider an on-line least squares regression problem with optimal solution ${\theta }^{\ast }$ and Hessian matrix H, and study a time-average stochastic gradient descent estimator of ${\theta }^{\ast }$. F…