Learning words in groups: fusion algebras, tensor ranks and grokking

Maor Shutman, Oren Louidor, Ran Tessler

In this work, we demonstrate that a simple two-layer neural network with standard activation functions can learn an arbitrary word operation in any finite group, provided sufficien…