2 papers
cs.LG2025
Scaling Law for Stochastic Gradient Descent in Quadratically Parameterized Linear Regression
Shihong Ding, Haihan Zhang, Hanzhen Zhao +1
In machine learning, the scaling law describes how the model performance improves with the model and data size scaling up. From a learning theory perspective, this class of results…
cs.LG2023
Accelerated Gradient Algorithms with Adaptive Subspace Search for Instance-Faster Optimization
Yuanshi Liu, Hanzhen Zhao, Yang Xu +2
Gradient-based minimax optimal algorithms have greatly promoted the development of continuous optimization and machine learning. One seminal work due to Yurii Nesterov [Nes83a] est…