Understanding weight-magnitude hyperparameters in training binary networks

Joris Quist, Yunqiang Li, Jan van Gemert

Binary Neural Networks (BNNs) are compact and efficient by using binary weights instead of real-valued weights. Current BNNs use latent real-valued weights during training, where s…