Training Sparse Neural Network by Constraining Synaptic Weight on Unit Lp Sphere

Weipeng Li, Xiaogang Yang, Chuanxiang Li +2

Sparse deep neural networks have shown their advantages over dense models with fewer parameters and higher computational efficiency. Here we demonstrate constraining the synaptic w…