Efficient Neural Network Implementation with Quadratic Neuron

Zirui Xu, Jinjun Xiong, Fuxun Yu +1

Previous works proved that the combination of the linear neuron network with nonlinear activation functions (e.g. ReLu) can achieve nonlinear function approximation. However, simpl…