Clebsch-Gordan Transformer: Fast and Global Equivariant Attention

Owen Lewis Howell, Linfeng Zhao, Xupeng Zhu +6

The global attention mechanism is one of the keys to the success of transformer architecture, but it incurs quadratic computational costs in relation to the number of tokens. On th…