Dynamic Learning Rate Decay for Stochastic Variational Inference

Maximilian Dinkel, Gil Robalo Rei, Wolfgang A. Wall

Like many optimization algorithms, Stochastic Variational Inference (SVI) is sensitive to the choice of the learning rate. If the learning rate is too small, the optimization proce…