On Dimension-Free Transformer: An Application of STP to AI

Daizhan Cheng

The matrix expressions for every parts of a transformer are firstly described. Based on semi-tensor product (STP) of matrices the hypervectors are reconsidered and the linear trans…