Transformer models are gauge invariant: A mathematical connection between AI and particle physics

Leo van Nierop

In particle physics, the fundamental forces are subject to symmetries called gauge invariance. It is a redundancy in the mathematical description of any physical system. In this ar…