An Algorithm for Training Polynomial Networks

Roi Livni, Shai Shalev-Shwartz, Ohad Shamir

We consider deep neural networks, in which the output of each node is a quadratic function of its inputs. Similar to other deep architectures, these networks can compactly represen…