Clifford Algebraic Rotor Embeddings : Maybe embeddings should start to CARE

Sameeksha Sriram, Ayush Paliwal, Alexander S. Ecker +1

Rotary Positional Embeddings (RoPE) have demonstrated exceptional performance as a positional encoding method, consistently outperforming their baselines. While recent work has sou…