Expressivity of Shallow Neural Networks Over Finite Fields

Maksym Zubkov, Carol Wu, Shiwei Yang +2

We study the expressivity of shallow polynomial neural networks (PNNs) with monomial activation functions over finite fields. For a given architecture, we define a neuromanifold as…