Learning Discretized Neural Networks under Ricci Flow

Jun Chen, Hanwen Chen, Mengmeng Wang +3

In this paper, we study Discretized Neural Networks (DNNs) composed of low-precision weights and activations, which suffer from either infinite or zero gradients due to the non-dif…