Weight Compander: A Simple Weight Reparameterization for Regularization

Rinor Cakaj, Jens Mehnert, Bin Yang

Regularization is a set of techniques that are used to improve the generalization ability of deep neural networks. In this paper, we introduce weight compander (WC), a novel effect…