Logic and the $2$-Simplicial Transformer

James Clift, Dmitry Doryn, Daniel Murfet +1

We introduce the $2$-simplicial Transformer, an extension of the Transformer which includes a form of higher-dimensional attention generalising the dot-product attention, and uses…