AskewSGD : An Annealed interval-constrained Optimisation method to train Quantized Neural Networks

Louis Leconte, Sholom Schechtman, Eric Moulines

In this paper, we develop a new algorithm, Annealed Skewed SGD - AskewSGD - for training deep neural networks (DNNs) with quantized weights. First, we formulate the training of qua…