Cheap Bootstrap for Fast Uncertainty Quantification of Stochastic Gradient Descent

Henry Lam, Zitong Wang

Stochastic gradient descent (SGD) or stochastic approximation has been widely used in model training and stochastic optimization. While there is a huge literature on analyzing its…