Reducing Parameter Space for Neural Network Training

Tong Qin, Ling Zhou, Dongbin Xiu

For neural networks (NNs) with rectified linear unit (ReLU) or binary activation functions, we show that their training can be accomplished in a reduced parameter space. Specifical…