Regularization in network optimization via trimmed stochastic gradient descent with noisy label

Kensuke Nakamura, Bong-Soo Sohn, Kyoung-Jae Won +1

Regularization is essential for avoiding over-fitting to training data in network optimization, leading to better generalization of the trained networks. The label noise provides a…