25 citations · 43 across the 12 of their papers we have counts for
3 papers · 1 filter
Weight Compander: A Simple Weight Reparameterization for Regularization
Rinor Cakaj, Jens Mehnert, Bin Yang
Regularization is a set of techniques that are used to improve the generalization ability of deep neural networks. In this paper, we introduce weight compander (WC), a novel effect…
Dimensionality Reduced Training by Pruning and Freezing Parts of a Deep Neural Network, a Survey
Paul Wimmer, Jens Mehnert, Alexandru Paul Condurache
State-of-the-art deep learning models have a parameter count that reaches into the billions. Training, storing and transferring such models is energy and time consuming, thus costl…
FreezeNet: Full Performance by Reduced Storage Costs
Paul Wimmer, Jens Mehnert, Alexandru Condurache
Pruning generates sparse networks by setting parameters to zero. In this work we improve one-shot pruning methods, applied before training, without adding any additional storage co…