Weight-Sharing Regularization

Mehran Shakerinava, Motahareh Sohrabi, Siamak Ravanbakhsh +1

Weight-sharing is ubiquitous in deep learning. Motivated by this, we propose a "weight-sharing regularization" penalty on the weights $w\in {\mathbb{R}}^d$ of a neural network, defi…