Determinantal point processes based on orthogonal polynomials for sampling minibatches in SGD

Remi Bardenet, Subhro Ghosh, Meixia Lin

Stochastic gradient descent (SGD) is a cornerstone of machine learning. When the number N of data items is large, SGD relies on constructing an unbiased estimator of the gradient o…