Algebraic Expressivity Certificates for Shallow Polynomial Neural Networks

Sepehr Akbari, Shahrzad Jamshidi

We study exact representability by bias-free shallow polynomial neural networks using algebraic geometry. Over $\mathbb{C}$, a width-$r$ network with activation $z\mapsto z^d$ comp…