The Interplay of Statistics and Noisy Optimization: Learning Linear Predictors with Random Data Weights

Gabriel Clara, Yazan Mash'al

We analyze gradient descent with randomly weighted data points in a linear regression model, under a generic weighting distribution. This includes various forms of stochastic gradi…