Factor Augmented High-Dimensional SGD

Shubo Li, Yuefeng Han, Xiufan Yu

Stochastic gradient descent (SGD) is a fundamental optimization algorithm widely used in modern machine learning. In this paper, we propose Factor-Augmented SGD (FSGD), a new optim…