Scaling Law for Stochastic Gradient Descent in Quadratically Parameterized Linear Regression

Shihong Ding, Haihan Zhang, Hanzhen Zhao +1

In machine learning, the scaling law describes how the model performance improves with the model and data size scaling up. From a learning theory perspective, this class of results…