Stochastic Gradient Langevin Dynamics Based on Quantization with Increasing Resolution

JInwuk Seok, Changsik Cho

Stochastic learning dynamics based on Langevin or Levy stochastic differential equations (SDEs) in deep neural networks control the variance of noise by varying the size of the min…