Fast gradient descent for drifting least squares regression, with application to bandits

Nathaniel Korda, Prashanth L. A., Rémi Munos

Online learning algorithms require to often recompute least squares regression estimates of parameters. We study improving the computational complexity of such algorithms by using…