PR Product: A Substitute for Inner Product in Neural Networks

Zhennan Wang, Wenbin Zou, Chen Xu

In this paper, we analyze the inner product of weight vector w and data vector x in neural networks from the perspective of vector orthogonal decomposition and prove that the direc…