BitNet: Bit-Regularized Deep Neural Networks

Aswin Raghavan, Mohamed Amer, Sek Chai +1

We present a novel optimization strategy for training neural networks which we call "BitNet". The parameters of neural networks are usually unconstrained and have a dynamic range d…