Layerwise Progressive Freezing Enables STE-Free Training of Deep Binary Neural Networks

Evan Gibson Smith, Bashima Islam

We investigate progressive freezing as an alternative to straight-through estimators (STE) for training binary networks from scratch. Under controlled training conditions, we find…