SVGD: A Virtual Gradients Descent Method for Stochastic Optimization

Zheng Li, Shi Shu

Inspired by dynamic programming, we propose Stochastic Virtual Gradient Descent (SVGD) algorithm where the Virtual Gradient is defined by computational graph and automatic differen…