Variational Stochastic Gradient Descent for Deep Neural Networks

Haotian Chen, Anna Kuzina, Babak Esmaeili +1

Current state-of-the-art optimizers are adaptive gradient-based optimization methods such as Adam. Recently, there has been an increasing interest in formulating gradient-based opt…