On the Anatomy of Attention

Nikhil Khatri, Tuomas Laakkonen, Jonathon Liu +1

We introduce a category-theoretic diagrammatic formalism in order to systematically relate and reason about machine learning models. Our diagrams present architectures intuitively…