Simplicity Suffices for Parameter Noise Injection in Stochastic Gradient Descent

Benjamin Leblanc, Louis-Jacob Lebel, Teddy Kana +1

Injecting noise into the optimization process is a well-established technique for improving the training and generalization of deep neural networks. Yet, despite the breadth of exi…