The Transformer Revolution, Part 1: Dynamic Processing through Output-Weight Interconnections

Marco Giunti, Fabrizia Giulia Garavaglia

We reinterpret Transformer inference by developing a functionally equivalent mechanical-structural description of its functional architecture. Parameterized transformations of toke…