SGD with Dependent Data: Optimal Estimation, Regret, and Inference

Yinan Shen, Yichen Zhang, Wen-Xin Zhou

This work investigates the performance of the final iterate produced by stochastic gradient descent (SGD) under temporally dependent data. We consider two complementary sources of…