Geometry of Polynomial Neural Networks

Kaie Kubjas, Jiayi Li, Maximilian Wiesmann

We study the expressivity and learning process for polynomial neural networks (PNNs) with monomial activation functions. The weights of the network parametrize the neuromanifold. I…