Scaling Laws for Dynamic Mini-Batch SGD in Sketched Linear Regression

Ziyan Chen, Zhongzhu Zhou, Ding-Xuan Zhou

Mini-batching is central to large-scale optimization, yet its role in statistical scaling laws remains limited. We study one-pass and multi-pass batch SGD for sketched linear regre…