Complex Stochastic Gradient Descent and Directional Bias in Reproducing Kernel Hilbert Spaces

Natanael Alpay, Emeric Battaglia

Stochastic Gradient Descent (SGD) is a known stochastic iterative method popular for large-scale convex optimization problems due to its simple implementation and scalability. Some…