Quaternion Self-Attention with Shared Scores

Shogo Yamauchi, Tohru Nitta, Hideaki Tamori

Quaternion neural networks are parameter-efficient and model multidimensional dependencies by representing four related features as a single entity. However, existing quaternion se…